Amendments to the Specification: 

Amend the paragraph beginning at column 1, line 5, as follows: 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application is a continuation of U.S. Patent 
Application Serial No. 09/312,036 filed May 14, 1999 which is a 
continuation of U.S. Patent Application Serial No. 08/682,904 
filed July 16, 1996, now U.S. Patent 5,959,574 which is a 
continuation-in-part of U.S. Patent Application Serial No. 
08/404,024, filed March 14, 1995 and issued July 16, 1996 as U.S. 
Patent No. 5,537,119, which is a continuation-in-part of U.S. 
Patent Application Serial No. 08/171,327 filed December 21, 1993, 
now U.S. Patent No. 5,406,289. 

Delete the paragraph heading and paragraph beginning at column 1, line 14. 
Insert the following heading before the paragraph beginning at column 1 , line 21 : 

a. Field of the Invention 

Insert the following heading before the paragraph beginning at column 1, line 23: 

b. Description of the Background 

Amend the paragraph beginning at column 1, line 23, as follows: 

There are many situations where the courses of multiple 
objects in a region must be tracked. Typically, radar is used to 
scan the region and generate discrete images or "snapshots" based 
on sets of returns or observations. In some types of tracking 
systems, all the returns from any one object are represented in 
an image as a single point unrelated to the shape or size of the 
objects. "Tracking" is the process of identifying a sequence of 
points from a respective sequence of the images that represents 
the motion of an object. The tracking problem is difficult when 
there are multiple closely spaced objects because the objects can 
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change [ their] speed and direction rapidly and move into and out 
of the line of sight for other objects. The problem is 
exacerbated because each set of returns may result from noise as 
well as echoes from the actual objects. The returns resulting 
from the noise are also called false positives. Likewise, the 
radar will not detect all echoes from the actual objects and this 
phenomena is called a false negative or "missed detect" error. 
For tracking airborne objects, a large distance between the radar 
and the objects diminishes the signal to noise ratio so the 
number of false positives and false negatives can be high. For 
robotic applications, the power of the radar is low and as a 
result, the signal to noise ratio can also be low and the number 
of false positives and false negatives high. 

Amend the paragraph beginning at column 1, line 55, as follows: 

While identifying the track of an object, a kinematic model 
may be generated describing the [ object's] location, velocity and 
acceleration [may be generated] of the object . Such a model 
provides the means by which the [object's ] future motion of the 
object can be predicted. Based upon such a prediction, 
appropriate action may be initiated. For example, in a military 
application there is a need to track multiple enemy aircraft or 
missiles in a region to predict their objective, plan responses 
and intercept them. Alternatively, in a commercial air traffic 
control application there is a need to track multiple commercial 
aircraft around an airport to predict their future courses and 
avoid collision. Further, [ in] these and other applications, 
such as robotic applications, may use radar, sonar, infrared or 
other object detecting radiation bandwidths for tracking objects. 
In particular, in robotic applications reflected radiation can be 
used to track a single object which moves relative to the robot 
(or vice versa) so the robot can work on the object. 
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Amend the paragraph beginning at column 2, line 5, as follows: 

Consider the very simple example of two objects being 
tracked and no false positives or false negatives. The radar, 
after scanning at time t lr reports objects at two locations in a 
first observation set. That is, it returns a set of two 
observations {o llf o 12 } . At time t 2 it returns a similar set of 
two observations {o 21 , o 22 ) from a second observation set. 
Suppose from prior processing that track data for two tracks T 1 
and T 2 includes the locations at t 0 of two objects. Track T 1 may 
be extended through the points in the two sets of observations in 
any of four ways, as may track T 2 . The possible extensions of 1 1 
can be described as: {T lr o llr o 21 ) , { T x , o n , o 22 } , [T lr o l2r o 21 } and 
i T if °i2r o 22 } . Tracks can likewise be extended from T 2 in four 
possible ways^ including [,] { T 2 , o 12 , o 21 ) . Figure 1 illustrates 
these five (out of eight) possible tracks (to simplify the 
problem for purposes of explanation) . The five track extensions 
are labeled h 11 , h 12 , h 13 , h 14l and h 21 wherein h n is derived from 
{T lf o llr o 21 ) , h 12 is derived from {T lf o n , o 22 } , h 13 is derived 
from {T lr o 12 , o 21 ] , h 14 is derived from {T lr o 12 , o 22 } , and h 21 is 
derived from { T 2 , o u , o 21 } . The problem of determining which such 
track extensions are the most likely or optimal is hereinafter 
known as the assignment problem. 

Amend the paragraph beginning at column 2, line 39, as follows: 

Figure 2 illustrates a two by two by two matrix, c, that 
contains the costs for each point in relation to each possible 
track. The cost matrix is indexed along one axis by the track 
number, along another axis by the image number and along the 
third axis by a point number. Thus, each position in the cost 
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matrix lists the cost for a unique combination of points and a 
track, one point from each image. Figure 2 also illustrates a 
{0, 1} assignment matrix, z, which is defined with the same 
dimensions as the cost matrix. Setting a position in the 
assignment matrix to "one" means that the equivalent position in 
the cost matrix is selected into the solution. The illustrated 
solution matrix selects the {h 14 , h 21 } solution previously 
described. Note that for the above example of two tracks and two 
snapshots, the resulting cost and assignment matrices are [three 
dimensional] three-dimensional . As used in this patent 
application, the term "dimension" means the number of axes in the 
cost or assignment matrix while size refers to the number of 
elements along a typical axis. The costs and assignments have 
been grouped in matrices to facilitate computation. 

Amend the paragraph beginning at column 3, line 12, as follows: 

For a [3-dimensionall three-dimensional problem, as is 
illustrated in Figure 1, but with N x (initial) tracks, N 2 
observations in scan 1, N 3 observations in scan 2, false 
positives and negatives assumed, the assignment problem can be 
formulated as: 

(Q.i) r n.oi ] 

z. . .^1, i, = l,...Nv_ 

hhh 

a point or observation 



(b) Subject to: 



tt 



(d) 



tt 
tt 



1 = 1 '2=1 

where "c" is the cost and "z" is 
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assignment, as in Figure 2. 



Amend the paragraph beginning at column 3, line 35, as follows: 

The minimization equation or equivalently objective function 
[[1.0] (a) 1 (0.1 (a) ) specifies the sum of the element by element 
product of the c and z matrices. The summation includes 
hypothesis representations z ili2i3 with observation number zero 
being the gap filler observation. Equation [[1.0] (b) 1 (0 . 1 (b) ) 
requires that each of the tracks T lr . . . ,T Nl be extended by one and 
only one hypothesis. Equation [[1.0] (c) 1 (0 . 1 (c) ) relates to 
each point or observation in the first observation set and 
requires that each such observation, except the gap filler, can 
only associate with one track butj_ because of the "less than" 
condition^ it might not associate with any track. Equation 
[ [1.0] (d) 1 (0.1 (d) ) is like [ [1.0] (c) 1 (0.1 (c) ) except that it is 
applicable to the second observation set. Equation 
[[1.0] (e) ] (0 . 1 (e) ) requires that elements of the solution matrix 
z be limited to the zero and one values. 

Amend the paragraph beginning at column 3, line 50, as follows: 

The only known method to solve Problem Formulation 
rrO.lll (1.0) exactly is a method called "Branch and Bound." This 
method provides a systematic ordering of the potential solutions 
so that solutions with a same partial solution are accessible via 
a branch of a tree describing all possible solutions whereby the 
cost of unexamined solutions on a branch are incrementally 
developed as the cost for other solutions on the branch are 
determined. When the developing cost grows to exceed the 
previously known minimal cost (i.e., the bound) then enumeration 
of the tree branch terminates. Evaluation continues with a new 
branch. If evaluation of the cost of a particular branch 
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completes, then that branch has lower cost than the previous 
bound so the new cost replaces the old bound. When all possible 
branches are evaluated or eliminated then the branch that had 
resulted in the last used bound is the solution. If we assume 
that Nj, = N 2 = N 3 = n and that branches typically evaluate to half 
there full length, then workload associated with "branch and 
bound" is proportional to («!|-^]!) 2 - This workload is unsuited to 
real time evaluation. 

Amend the paragraph beginning at column 4, line 13, as follows: 

Messrs. Frieze and Yadagar in dealing with a problem related 
to scheduling combinations of resources, as in job, worker and 
work site, showed that Problem Formulation ["TO. Ill (1.0) applied. 
They further described a solution method based upon an extension 
of the Lagrangian Relaxation previously mentioned. The two 
critical extensions provided by Messrs. Frieze and Yadagar were: 

(1) an iterative procedure that permitted the lower bound on the 
solution to be improved (by "hill climbing" described below) and 

(2) the recognition that when the lower bound of the relaxed 
problem was maximized, then there existed a method to recover the 
solution of the non-relaxed problem in most cases using 
parameters determined at the maximum. The procedures attributed 
to Messrs. Frieze and Yadagar are only applicable to the [3- 
dimensionall three-dimensional problem posed by Problem 
Formulation r TO . 11 1 (1.0) and where the cost matrix is fully 
populated. However, tracking multiple airborne objects usually 
requires solution of a much higher dimensional problem. 

Amend the paragraph beginning at column 4, line 3 1 , as follows: 

Figures 1 and 2 illustrate an example where "look ahead" 
data from the second image improved the assignment accuracy for 
the first image. Without the look ahead, and based only upon a 
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simple nearest neighbor approach, the assignments in the first 
set would have been reversed. Problem Formulation \ [0 . 11 1 (1.0) 
and the prior art only permit looking ahead one image. In the 
prior art it was known that the accuracy of assignments will 
improve if the process looks further ahead, however no practical 
method to optimally incorporate look ahead data existed. Many 
real radar tracking problems involve hundreds of tracks, 
thousands of observations per observation set and matrices with 
dimensions in the range of 3 to 25 including many images of look 
ahead. 

Amend the paragraph beginning at column 5, line 14, as follows: 

A previously known Multiple Hypothesis Testing (MHT) 
algorithm (see Chapter 10 of S.S. Blackmanf.l. Multiple-Target 
Tracking with Radar Applications [ , Chapter 10,]^ Artech House^. 
Norwood^ MA, 1986.J related to formulation and scoring. The MHT 
procedure describes how to formulate the sparse set of all 
reasonable extension hypothesis (for Figure 1 the set { h n . . . h 24 ) ) 
and how to calculate a cost of the hypothesis {T ir o ljf o 2k } based 
upon the previously calculated cost for hypothesis { T ir o 1} } . The 
experience with the MHT algorithm, known in the prior art, is the 
basis for the assertion that look ahead through k sets of 
observations results in improved assignment of observations from 
the first set to the track. 

Amend the paragraph beginning at column 5, line 26, as follows: 

In theory, the MHT procedure uses the extendable costing 
procedure to defer assignment decision until the accumulated 
evidence supporting the assignment becomes overwhelming. When it 
makes the assignment decision^ it then eliminates all potential 
assignments invalidated by the decision in a process called 
"pruning the tree." In practice, the MHT hypothesis tree is 
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limited to a fixed number of generations and the overwhelming 
evidence rule is replaced by a most likely and feasible rule. 
This rule considers each track independently of others and is 
therefore a local decision rule. 

Amend the paragraph beginning at column 6, line 34, as follows: 

In one embodiment of the invention, each ic-dimensional 
assignment problem [2<k<M, 1 (2 < k < M) is iteratively reduced to 
a [k-1 dimensional] (k-1) -dimensional problem until a [2- 
dimensionall two-dimensional problem is specified or formulated. 
Subsequently, the ^-dimensional! two-dimensional problem 
formulated is solved directly and a "recovery" technique is used 
to iteratively recover an optimal or near-optimal solution to 
each ic-dimensional problem from a derived [(k-1) dimensional 1 (k- 
1) -dimensional problem k= 2,3,4, . . . M. 

Amend the paragraph beginning at column 6, line 42, as follows: 

In performing each recovery step (of obtaining a solution to 
a ^--dimensional problem using a solution to a (k-1) -dimensional 
problem) j_ an auxiliary function [,] is utilized. In particular, 
to recover an optimal or near-optimal solution to a ^-dimensional 

problem, an auxiliary function, W k _ 1 [ , ] (k=A , 5 , . . . , M]_, is 

specified and a region or domain is determined wherein this 
function is maximized, whereby values of the region determine the 
penalty factors of the (k-1 ) -dimensional problem such that 
another r2-dimensional1 two-dimensional problem can be formulated 
which determines a solution to the Jc-dimensional problem using 
the penalty factors of the (k-1 ) -dimensional problem. 
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Amend the paragraph beginning at column 6, line 54, as follows: 



Each Auxiliary function W k , Jc=3, . . . ,M-1, is a function of 
both lower dimensional [problem] problems , penalty factors^, and 
a solution at the dimension k at which the penalized cost 
function is solved directly (typically a ^-dimensional! two- 
dimensional problem) . Further, in determining, for auxiliary 
function ¥ kf a peak region, a gradient of the auxiliary function 
is determined, and utilized to identify the peak region. Thus, 
gradients are used for each of the approximation functions W 3 , 
W 4 , . . . , ¥ M _! which are sequentially formulated and used in 
determining penalty factors [penalty factors ] until rtm-ll M-1 is 
used in determining the penalty factors for the [M-l 
dimensional] (M-l ) -dimensional problem. Subsequently, once the 
M-dimensional problem is solved (using a r2-dimensional 1 two- 
dimensional problem to go from an (M-l) [ dimensional] -dimensional 
solution to an M-dimensional solution) , one or more of the 
following actions are taken based on the track assignments: 
sending a warning to aircraft or a ground or sea facility, 
controlling air traffic, controlling anti-aircraft or anti- 
missile equipment, taking evasive action, working on one of the 
objects . 

Amend the paragraph beginning at column 7, line 3, as follows: 

According to one feature of this first embodiment of the 
present invention, the following steps are also performed before 
the step of defining the auxiliary function. A preliminary 
auxiliary function is defined for each of the lower dimensional 
problems having a dimension equal or one greater than the 
dimension at which the penalized cost function is solved 
directly. The preliminary auxiliary function is a function of 
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lower order penalty values and a solution at the dimension at 
which the penalized cost function was solved directly. In 
determining a gradient of the preliminary auxiliary function, 
step in the direction of the gradient to identify a peak region 
of the preliminary auxiliary function and determine penalty 
factors at the peak region. Iteratively repeat the defining, 
gradient determining, stepping and peak determining steps to 
define auxiliary functions at successively higher dimensions 
until the auxiliary function [at 6-18 (k-1) 1 dimension (k-1) is 
determined. In an alternative second embodiment of the present 
invention, instead of reducing the dimentionality of the M- 
dimensional assignment problem by a single dimension at a time, a 
plurality of dimensions are relaxed simultaneously. This new 
strategy has the advantage that when the M-dimensional problem is 
relaxed directly to a [ 2-dimensionall two-dimensional assignment 
problem, then all computations may be performed precisely without 
utilizing an auxiliary function such as W k as in the first 
embodiment. More particularly, the second embodiment solves the 
first optimization problem (i.e., the M- dimensional assignment 
problem) by specifying (i.e., creating, generating, formulating 
and/or defining) a second optimization problem. The second 
optimization problem includes a second objective function and a 
second collection of constraint sets wherein: 

a) the second objective function is a combination of the 
first objective function and penalty factors or terms 
determined for incorporating [M-m constraint 1 (M-m) - 
constraint sets of the first optimization problem into 
the second objective function; 

b) the constraint sets of the second collection include 
only m of the constraint sets of the first collection 
of constraints, 

wherein [2<m<M-11 2 < m < M -1 . Note that, once the second 
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optimization problem has been specified or formulated, an optimal 
or near-optimal solution is determined and that solution is used 
in specifying (i.e, creating, generating, formulating and/or 
defining) a third optimization problem of [M-m] (M-m) dimensions 
(or equivalently constraint sets) . The third optimization 
problem is subsequently solved by decomposing it using the same 
procedure of this second embodiment as was used to decompose the 
first optimization problem above. Thus, a plurality of 
instantiations of the third optimization problem are specified, 
each successive instantiation having a lower number of 
dimensions, until an instance of the third optimization problem 
is a [two dimensional] two-dimensional assignment problem which 
can be solved directly. Subsequently, whenever an instance of 
the third optimization problem is solved, the solution is used to 
recover a solution to the instance of the first optimization 
problem from which this instance of the third optimization was 
derived. Thus, an optimal or near-optimal solution to the 
original first optimization problem may be recovered through 
iteration of the above steps. 

Amend the paragraph beginning at column 7, line 64, as follows: 

As mentioned above, the second embodiment of the present 
invention is especially advantageous when \m=21 m =2 , since in 
this case all computations may be performed precisely and without 
utilizing auxiliary functions. 

Amend the paragraph beginning at column 8, line 13, as follows: 

Figure 4 is a flow chart of a process according to the prior 
art for solving a [ 3 -dimensional] three-dimensional assignment 
problem. 

Amend the paragraph beginning at column 8, line 15, as follows: 
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Figure 5 [Is]is a flow chart of a process according to the 
present invention for solving a .^-dimensional assignment problem 
where " k" is greater than or equal to 3. 

Amend the paragraph beginning at column 8, line 20, as follows: 

Figure 7 is another block diagram of the present invention 
for solving the .^-dimensional assignment problem where " k" is 
greater than or equal to [3] three (3) . 



Amend the paragraph beginning at column 8, line 23, as follows: 

Figure 8 is a flowchart describing the procedure for solving 
[a] an n-dimensional assignment problem according to the second 
embodiment of the invention. 

Amend the paragraph beginning at column 8, line 60, as follows: 

The invention generates A: -dimensional matrices where k is 
the number of images or sets of observation data in the look 
ahead window plus one. Then, the invention formulates a k- 
dimensional assignment problem as in I" [1 . 01 1 (0.1) above. 

Amend the paragraph beginning at column 9, line 7 as follows: 

Consider the integer programming problem 
Minimize v(z) = c T z 

Subject to: Az < hj_ 
Bz < 

z i is an integer for i 6 !_„_ 

[ [1.0.1] 1 (0.2) 

where the partitioning of the constraints is natural in some 
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sense. Given a multiplier vector [u>01 u>0 , the Lagrangian 
relaxation of [ [ 1 . 0 . 1 ] ] ( 0 . 2 ) relative to the constraints 
[Bz<d]Bz_g_d is defined to be 
[<£<DTT] 

&(u) = Minimize f c T z+u T (Bz-d) } (0.3) 

Subject to: [Az<b] Az < b , 

z ± is an integer for i € 

[[1.0.2]] 

If the constraint set rBz<d1 Bz < d is replaced by [Bz=d] Bz = d , 
the [nonnegativity] non-negativity constraint on u is removed. 
S£=c T z+u T (Bz-d) is the Lagrangian relative to the constraints 
[Bz<d1 Bz < d , and hence the name Lagrangian relaxation. The 
following fact gives the relationship between the objective 
functions of the original and relaxed problems. 

Amend the paragraph beginning at column 9, line 28, as follows: 

FACT A.l. If F is an optimal solution to f [1.011 1 (0.2) , 
then [0<v(T)] &(u) < v(z~) for all fu>01 u > 0 . If an optimal 
solution z of [ [1.021 1 (0.3) is feasible for [ [1.021 1 (0.3) , then 
z is an optimal solution for [ [1. 01 1 / (0.2) and [^Algorithm] 
0(u) = v (z) . 

[k 1=0} 

Amend the paragraph beginning at column 9, line 36, as follows: 

This leads to the following algorithm: 

Algorithm. Construct a sequence of multipliers \u y \Z. 0 
converging to the solution u of Maximize [{0>O}] { &(u) : u > 0 } 
and a corresponding sequence of feasible solutions {z k }j =0 of 
r ri. Oil 1 (0.2) as follows: 

1. Generate [in] an initial approximation u 0 . 



14 



2. Given u k , choose a search direction s k and a search 
distance a k [W k a k k W k ] so that ®{u v +a y s k )> <£(uj . Update the 
multiplier estimate u k by [u k+1 =u k +a k k ] u k+1 =u k +a k s k . 

3. Given u k+1 and a feasible solution z_ k+1 {u k+1 ) of 

r Tl . 021 1 (0.3) , recover a feasible solution z k+1 {u k+1 ) of the 
integer programming problem [[1.0111 (0.2) . 

4. Check the termination criteria. If the algorithm is 
not finished, set k=k+l and return to Step 2. Otherwise, 
terminate the algorithm. 

Amend the paragraph beginning at column 9, line 50, as follows: 

If i" is an optimal solution of [[1.0111 (0.2) , then 

[W k < W < v(z~) < (z k )] 

0(u k ) < <P(u) < v(F) < v(z k ). 
Since the optimal solution [z=z(u)] z = z(u) of [[1.0211 (0.3) is 
usually not a feasible solution of [[1.0111 (0.2) for any choice 
of the multipliers, 
[ 

0 ex a 

<t 

a a] 

$(u) is usually strictly less than v ("i") . The difference v("i~)- 
$(u) is called the "duality gap," which can be estimated by 
comparing the best relaxed and recovered solutions computed in 
the course of maximizing $(u). 

Amend the paragraph beginning at column 9, line 64 as follows: 

[ p < p < k] 

Thus, to eliminate the "<" in the constraint formulations 
(e.g., (0.1) (a) - (0.1) (d) ) that resulted from false positives, 
the constraint sets have been modified, as indicated above, to 
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incorporate a gap filler in each observation set to account for 
false positives. Thus, a zero for an index, i r , 1 < p < k in 
z\ 1 ...i k in problem [[1.11 (0.4) below indicates that the track 
extension represented by z k ll __ lk includes a false positive in the 
p th observation set. Note that this implies that a hypothesis be 
formed incorporating an observation with k-1 gap fillers, e.g., 
z o...oi p o...or i p *0- Thus, the resulting generalization of Problem 
Formulation f ri . 01 1 (0.1) without the "less than" complication 
within the constraints is the following Jo-Dimensional Assignment 
Problems in which [k>31 k > 3 : 

[[1.1]] (0-4) 



Subject to: a! - z i i =1 » ii = 1,...N 1jC _ 



t-i 

ij=0 i j _ 1 =0 ij +1 =0 i k =0 



for ij = 1, . . .N^ 
and j=2, . . . k - \j_ 



ii=0 i k .j=0 

\..i k 6 Vi n n=l, . . .,k^ 

where c and z are similarly dimensioned matrices representing 
costs and hypothetical assignments. Note, in general, for 
tracking problems these matrices are sparse. 



16 



Amend the paragraph beginning at column 10, line 29, as follows: 



After formulating the -dimensional assignment problem as in 
rn.111 (0.4) , the present invention solves the resulting problem 
so as to generate the outputs required by devices 110, 112, 122 
and 130. For each observation set 0 ± received from converter 104 
at time t ± where 1=1,...,^, the computer processes O t in a batch 
together with the other observation sets Oi_ k+1 , . . . , 0 ± and the 
track Ti.k, i.e., T i is the set of all tracks that have been 
defined up to but not including Oj . (Note, bold type 
designations refer to the vector of elements for the indicated 
time, i.e., the set of all observations in the scan or tracks 
existing at the time, etc.) The result of this processing is the 
new set of tracks T^ k+1 and a set of cost weighted possible 
solutions indicating how the tracks might extend to the current 
time t ± . At time t i+1 the batch process is repeated using the 
newest observation set and deleting the oldest. Thus, there is a 
moving window of observation sets which is shifted forward to 
always incorporate the most recent observation set. The effect 
is that input observation sets are reused for fk-11 (k-1) cycles 
and then on the observation set's [k-th]Jcff reuse each 
observation within the observation set is integrated into a 
track. 

Amend the paragraph beginning at column 10, line 50, as follows: 

Figure 7 illustrates various processes implemented upon 
receipt of each observation set. Except for the addition of the 
ic-dimensional assignment solving process 300 and the modification 
to scoring process 154 to build data structures suitable for 
process 300, all processes in Figure 7 are based upon prior art. 
The following processes 150 and 152 extend previously defined 
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tracks h^^.-, based on new observations. Gate formulation and 
output process 156 determines, for each of the previously defined 
tracks, a zone wherein the track may potentially extend based on 
limits of velocity, maneuverability and radar precision. One 
such technique to accomplish this is the cone method described 
previously. The definition of the zone is passed to gating 
process 150. When a new observation set 0 ± is received, the 
gating process 150 will match each member observation with the 
zone for each member of the hypothetical set h^ . After all 
input observations from O i are processed^, the new hypothesis set 
hi is generated by extending each track of the prior set of 
hypothetical tracks h^ either with missed detect gap fillers or 
with all new observation elements satisfying the track's zone. 
This is a [many to many] many-to-many matching in that each 
hypothesis member can be extended to many new observations and 
each new observation can be used to extend many hypotheses. It, 
however, is not a full matching in that any hypothesis will 
neither be matched to all observations nor vice versa. It is 
this matching characteristic that leads to the sparse matrices 
involved in the tracking process. Subsequently, gating 150 
forwards the new hypothesis set h ± to filtering process 152. 
Filtering process 152 determines a smooth curve for each member 
of h i . Such a smooth curve is more likely than a sharp turn from 
each point straight to the next point. Further, the filtering 
process 152 removes small errors that may occur in generating 
observations. Note that in performing these tasks, the filtering 
process 152 preferably utilizes a minimization of a least squares 
test of the points in a track hypothesis or a Kalman [Filtering] 
filtering approach. 
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Amend the paragraph beginning at column 11, line 20, as follows: 



As noted above, the foregoing track extension process 
requires knowledge of a previous track. For the initial 
observations, the following gating process 158 and filtering 
process 160 determine the "previous track" based on initial 
observations. In determining the initial tracks, the points from 
the first observation set form the beginning points of all 
possible tracks. After observation data from the next 
observation set is received, sets of simple [two point] two-point 
straight line tracks are defined. Then, promotion, gate 
formulation, and output step 162 determines a zone in which 
future extensions are possible. Note that filtering step 160 
uses curve fitting techniques to smooth the track extensions 
depending upon the number of prior observations that have 
accumulated in each hypothesis. Further note that promotion, 
gate formulation and output process 162 also determines when 
sufficient observations have accumulated to form a basis for 
promoting the track to processes 150 and 152 as described above. 

Amend the paragraph beginning at column 12, line 3, as follows: 

The assignment solving process 300 is described below. Its 
output is simply the list of assignments which constitute the 
most likely solution of the problem described by Equation 
r [1. 11 (0.4) . Note that both gate formulation and output 
processes 156 and 162 use (at different times) the list of 
assignments to generate the updated track history T ± to eliminate 
or prune alternative previous hypotheses that are prohibited by 
the actual assignments in the list, and^_ subsequently^, to output 
any required data. Also note that when one of the gate 
formulation and output processes 156 and 162 accomplish these 
tasks, the process will subsequently generate and forward the new 
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set of gates for each remaining hypothesis and the processes will 
then be prepared to receive the next set of observations. In one 
embodiment, the loop described here will generate zones for a 
delayed set of observations rather than the subsequent set. This 
permits processes 156 and 162 to operate on even observation sets 
while the scoring step 154 and £:-dimensional solving process 
operate on odd sets of observations, or vice versa. 

Amend the paragraph beginning at column 12, line 22, as follows: 

The assignment solving process 300 permits the present 
invention to operate with a window size of dimension k-1 for 
rk>31 some k > 3 . The upper limit on k depends only upon the 
computational power of the computer 106 and the response time 
constraints of system 100. The k-1 observation sets within the 
processing window plus the prior track history result in a k- 
dimensional Assignment Problem as described by Problem 
Formulation [ [1.11 1 (0.4) . The present invention solves this 
generalized problem including the processes required to consider 
false positives and negatives, and also the processes required to 
consider sparse matrix problem formulations. 

Amend the paragraph beginning at column 12, line 35, as follows: 

In describing a first embodiment of the Ar-dimensional 
assignment solver 300, it is worthwhile to also discuss the 
process of Figure 4 which is used by the solver 300. Figure 4 
illustrates use of the Frieze and Yadagar process as shown in 
prior art for transforming a [3-dimensional] three-dimensional 
assignment problem into a r2-dimensional 1 two-dimensional 
assignment problem and then use a hill climbing algorithm to 
solve the [ 3-dimensional 1 three-dimensional assignment problem. 
The solver 300 uses a Lagrangian Relaxation technique (well known 
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in the art) to reduce the dimension of an original [k- 
dimensionall ^-dimensional assignment problem ( [k>3] k > 3 ) down 
to a [3-dimensional] three-dimensional problem and then use the 
process of Figure 4 to solve the [3-dimensional] three- 
dimensional problem. Further note that the Lagrangian Relaxation 
technique is also utilized by the process of Figure 4 and that in 
using this technique the requirement that each point is assigned 
to one and only one track is relaxed. Instead, an additional 
cost, which is equal to a respective Lagrangian Coefficient ["u"] 
u, is added to the cost or objective function [[1.0 (a) 1 1 (0.1) (a) 
whenever a point is assigned to more than one track. This 
additional cost can be picked to weight the significance of each 
constraint violation differently, so this additional cost is 
represented as a vector of coefficients u which are correlated 
with respective observation points. Hill climbing will then 
develop a sequence of Lagrangian Coefficients sets designated 
(u 0 , ...,Uj, u j+1 , . . . , u p ) . That correspond to an optimum solution 
of the [2-dimensional] two-dimensional assignment problem. The 
assignments at this optimum solution are then used to "recover" 
the assignment solution of the [3-dimensional] three-dimensional 
assignment problem. 

Amend the paragraph beginning at column 12, line 63, as follows: 

In step 200 of Figure 4, initial values are selected for the 
u 0 coefficients. Because the Lagrangian Relaxation process is 
iterative, the initial values are not critical and are all 
initially selected as zero. In step 202, these additional costs 
are applied to the objective function [[1.0 (a)]] (0.1 (a) . With 
the addition of the costs ["u"] u, the goal is still to assign 
the points which minimize the total cost. This transforms 
Equation [[1.0 (a)]] (0.1 (a) , written for \k=3] k = 3 and altered 
to exclude mechanisms related to false positives and negatives, 
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into objective function [[2.1 (a) 11 (1.1) (a) . In the first 
iteration it is not necessary to consider the ["u"] u matrix 
because all ["u"] u values are set to zero. To relax the 
requirement that each point be assigned to one and only one 
track, the constraint Equation [[1.0 (d) ] ] (0.1 (d) is deleted, 
thereby permitting points from the last image to be assigned to 
more than one track. Note that while any axis can be chosen for 
relaxation, observation constraints are preferably relaxed. The 
effect of this relaxation is to create a new problem which must 
have the same solution in the first two axes but which can have a 
[differing] different solution in the third axis. The result is 
constraints [[2.1 (b-d) ] ] (1.1) (b-d) . 



Amend the paragraph beginning at column 13, line 17, as follows: 



[[2.1]] (1.1) 



(a) Minimize [ : ] 



1 1 fe„*-wK» 



(b) Subject to: ]T £ z iu =l, i x = l,...,^ 



22 £ i 2 = i,...,n 2j 

i 3 =l 

z... e {0,1} V z ;ii 



Amend the paragraph beginning at column 13, line 47, as follows: 

Step 204 then generates from the f 3-dimensional] three- 
dimensional problem described by Problem Formulation [[1.0]] 
(0.1) a new [2-dimensional] two-dimensional problem formulation 
which will have the same solution for the first two indices. As 



22 



Problem Formulation [[2.1]] (1.1) has no constraints on the 3 rd 
axis, any value within a particular 3 rd axis can be used in a 
solution, but using anything other than the minimum value from 
any [3-rd] 3^ axis has the effect of increasing solution cost. 
Conceptually, the effect of step 204 is to change the [3- 
dimensionall three-dimensional arrays in Problem Formulation 
[[2.2]] (1.1) into [2-dimensionall two-dimensional arrays as 
shown in Problem Formulation [[2.1]] (1.2) and to generate the 
new [2-dimensional] two-dimensional matrix m ili2 defined as shown 
in Equation [[2.3]] (1.3) . 

Amend the paragraph beginning at column 13, line 33, as follows: 

[[2.2]] (1.2) 

(a) Minimize [ : ] 

(b) Subject to: 

(c) 
(d) 



"■A 



Amend the paragraph beginning at column 13, line 64, as follows: 

The cost or objective function for the reduced problem as 



tt 



E E v i. ii - i 



^=1 i 3 =i 

N, N, 



i 3 =l 13 

Z H 6 {0,1} V z.. 



[[2.3]]] (1.3) 



Am: arg minimize {c ;; - u ; I i=l....,N,,} 
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defined by [[2.2 (a)]] (1.2) (a) , if evaluated at all possible 
values of u is a surface over the domain of [ U 3 ]_u. This surface 
is referred to as [ [<J>u] ] &(u) and is non-smooth but provable 
convex (i.e., it has a single peak and several other critical 
characteristics which form terraces). [Because of 1 Due to the 
convex characteristics of @(u) . the results from solving Problem 
Formulation (1 . 2) at any particular u i can be used to generate a 
new set of 
[$ u 

u 3 ] 

coefficients u j+1 whose corresponding [Problem Formulation [2.2] 
problem solution is a] cost value is closer to the peak of [<£> u 
Up] &(u) . The particular set of Lagrangian Coefficients that 
will generate the two-dimensional problem resulting in the 
maximum cost is designated u p . To recover the solution to the 
three-dimensional [dimensional] assignment problem requires 
solving the Equation [2.2] (1.2) problem corresponding to u p . 

Amend the paragraph beginning at column 14, line 15, as follows: 

In step 206, the [two dimensional] (two-dimensional) problem 
is solved directly using a technique known to those skilled in 
the art such as Reverse Auction for the corresponding cost and 
solution values. This is the evaluation of one point on the 
surface or for the first iteration @{u 0 ) . 

Amend the paragraph beginning at column 14, line 21, as follows: 

Thus, after this first iteration, the points have been 
assigned based on all "u" values being arbitrarily set to zero. 
Because the "u" values have been arbitrarily assigned, it is 
unlikely that these assignments are correct and it is likely that 
further iterations are required to properly assign the points. 
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Step 208 determines whether the points have been properly 
assigned after the first iteration by determining if for this set 
of assignments whether a different set of "u" values could result 
in a higher total cost. Thus, step 208 is implemented by 
determining the gradient of objective function [[2.2] (a)] (1.2 
(a) with respect to u 3 . If the gradient is substantially non- 
zero (greater than a predetermined limit) then the assignments 
are not at or near enough to the peak of the [<l>u] 
[U J+1 ] 

surface @(u) (decision 210) , and the new set of Laqrangian 
Coefficients u ^ is determined. 

Amend the paragraph beginning at column 14, line 36, as follows: 

Hill climbing Step 212 determines the u j+1 values based upon 
the Uj values, the direction resulting from protecting the 
previous gradient into the U 3 domain, and a step size. The 
solution value of the [2-dimensional] two-dimensional problem is 
the set of coefficients that minimize the [2-dimensional] two- 
dimensional problem and the actual cost at the minimum. Those 
coefficients augmented by the coefficients stored in m ili2 permit 
the evaluation (but not the minimization) of the cost term in 
Problem Formulation [[2.1]] (1.1) . These two cost terms are 
lower and upper bounds on the actual minimized cost of the [3- 
dimensional] three-dimensional problem, and the difference 
between them in combination with the gradient is used to compute 
the step size. 

Amend the paragraph beginning at column 14, line 50, as follows: 

With this new set of ["u"] u values, steps 202-210 are 
repeated as a second iteration. Steps 212 and 202-210 are 
repeated until the gradient as a function of u determined in step 
208 is less than the predetermined limit. This indicates that 
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the u p values which locate the peak area of the <P(u) surface are 
determined and that the corresponding Problem Formulation 

r f 2 . 2 1 1 (1.2) has been solved. Step 214 will attempt to use the 
assignments that resulted from this particular [2-dimensional] 
two-dimensional assignment problem to recover the solution of the 

[3-dimensional] three-dimensional assignment problem as described 
below. If the limit was chosen properly so that the ["u"] u 
values are close enough to the peak, this recovery will yield the 
proper set of assignments that rigidly satisfies the constraint 
that each point be assigned to one and only one track. However, 
if the ["u"] u values are not close enough to the peak, then the 
limit value for decision 210 is reduced and the repetition of 
steps 212 and 202-210 is continued. 

Amend the paragraph beginning at column 15, line 1, as follows: 

Step 214 recovers the [3-dimensional] three-dimensional 
assignment solution by using the assignment values determined on 
the last iteration through step 208. Consider the [2- 
dimensional] two-dimensional z assignment matrix to have l's in 
the locations specified by the list L I =(a i , b ± )l =1 . If the [3- 
dimensional] three-dimensional z matrix is specified by placing 
l's at the location indicated by the list L 2 =(a ir b ir ra a . b .)1 =1 then 
the result is a solution of Problem Formulation \ \2 . 11 1 (1 . 1) . 
Let L 3 =(m a . b .)l =1 be the list formed by the third index. If each 
member of L 3 is unique then the L 2 solution satisfies the third 
constraint so it is a solution to Problem Formulation [[1.0]] 
(0.1) . When this is not the case, recovery determines the 
minimal substitutions required within list L 3 so that it plus L 1 
will be a feasible solution, i.e., a solution which satisfies the 
constraints of a problem formulation, but which may not optimize 
the objective function of the problem formulation. This stage of 
the recovery process is formulated as a [2-dimensionall two- 
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dimensional assignment problem!":] as follows. Form a new cost 
matrix [c ifj ]l /j=1 where c i>j =c a . b . /j for 7=1...!^ and the N t term is 
the total number of cost elements in the selected row of the [3- 
dimensional] three-dimensional cost matrix. Attempt to solve 
this r2-dimensionall two-dimensional problem for the minimum 
using two constraints sets. If a feasible solution is found then 
the result will have the same form as list L 2 . Replace the first 
set of [indexes! indices by the indicated {a ir b ± ) pairs taken 
from list L 1 and the result will be a feasible solution of 
Problem Formulation [[1.1]] (0.4) . If no feasible solution to 
the new [2-dimensionall two-dimensional problem exists then 
further effort to locate the peak of [i> u] 0(u) is required. 

Delete the paragraph beginning at column 15, line 33, thru line 45. 

Amend the paragraph beginning at column 15, line 48, as follows: 

I . 1 . Generalization to a Multi-Dimensional Assignment 
Solving Process 

Let M be a fixed integer and assume that M is the dimension 
of the initial assignment problem to be solved. Thus, initially, 
the result of the scoring step 154 is a M-dimensional Cost Matrix 
which is structured as a sparse matrix (i.e., only a small 
percentage of the entries in the cost and assignment matrices are 
filled or non-zero) . Individual cost elements represent the 
likelihood that a track T , : as extended by the set of observations 
{Oy|i=l, . . . , M-l} , is not valid. Because the matrix is sparse the 
list of cost elements is stored as a packed list, and then for 
each dimension of the matrix, a vector of a variable length list 
of pointers to the cost elements is generated and stored. This 
organization means that for a particular observation [o<,10 fJ - for 
the j th list in the i th vector will be a list of pointers to all 
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hypotheses in which [o 9 ] O i: ,_participates . This structure is 
further explained in the following section dealing with problem 
partitioning . 

Amend the paragraph beginning at column 15, line 58, as follows: 

The objective of the assignment solving process is to select 
from the set of all possible combinations of track extensions a 
subset that satisfies two criteria. First, each point in the 
subset of combinations should be assigned to one and only one 
track and therefore, included in one and only one combination of 
the subset, and second, the total of the scoring sums for the 
combinations of the subset should be minimized. This yields the 
following M-dimensional equations where fk=Ml k = M : 



[[3.1]] (1.4) 



(a) Minimize: v k (z ) 



k 



(c) 



N, JNL , 

12=0 i t =0 I k 

*K ^ ^ k 

i,=0 i j _ 1 =0 ij tl =0 i k =0 1 k 



(b) Subject to: 2^-2^ z i i =1 i i = 1/--.N : 



for ij = 1, . . .Nj 
and j=2, . . . k-lj. 

i k = 1, . . .N kx . 



zf ; e {0,1} for all i 1 . . . l k 
ij...i k 



and where c k is the cost matrix [c^ _ ijf ] which is a function of 
the distance between the observed point z K and the smoothed track 
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determined by the filtering step, and v k is the cost function. 
This set of equations is similar to the set presented in Problem 
Formulation f \1. 11 1 (0.4) except that it includes the subscript 
and superscript k notation. Thus, in solving the M-dimensional 
Assignment Problem the invention reduces this problem to an [M-l 
dimensional 1 (M-l ) -dimensional Assignment Problem and then to an 
[N-2 dimensional] (N-2 ) -dimensional Assignment Problem, etc. 
Further, the symbol ke { 3, . . . , M) customizes Problem Formulation 
[[3.1]] (0.4) to a particular relaxation level. That is, the 
notation is used to reference data from levels relatively removed 
as in c k+1 are the cost coefficients which existed prior to this 
level of relaxed coefficients c k . Note that actual observations 
are numbered from 1 to N imI _ where N ± is the number of observations 
in observation set i. Further note that the added [0] 0 
observation in each set of observations is the unconstrained "gap 
filler." This element serves as a filler in substituting for 
missed detects, and a sequence of these elements including only 
one true observation represents the possibility that the 
observation is a false positive. Also note that by being 
unconstrained a gap filler may be used in as many hypotheses as 
required. 

Amend the paragraph beginning at column 16, line 45, as follows: 

While direct solution to [[3.1]] (0.4) would give the 
precise assignment, the solution of .^-dimensional equations 
directly for large k is too complex and time consuming for 
practice. Thus, the present invention solves this problem 
indirectly. 

Amend the paragraph beginning at column 16, line 50, as follows: 

The following is a short description of many aspects of the 
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present invention and includes some steps according to the prior 
art. The first step in solving the problem indirectly is to 
reduce the complexity of the problem by the previously known and 
discussed Lagrangian Relaxation technique. According to the 
Lagrangian Relaxation technique, the absolute requirement that 
each point is assigned to one and only one track is relaxed such 
that for some one image, points can be assigned to more than one 
track. However, a penalty based on a respective Lagrangian 
Coefficient u k is added to the cost function when a point in the 
image is assigned to more than one track. The Lagrangian 
Relaxation technique reduces the complexity or "dimension" of the 
formulation of the assignment problem because constraints on one 
observation set are relaxed. Thus, the Lagrangian Relaxation is 
performed iteratively to repeatedly reduce the dimension until a 
[2-dimensional] two-dimensional penalized cost function problem 
results as in Problem Formulation [[2.1]] (1.1) . This [2- 
dimensional] two-dimensional problem is solved then directly by a 
previously known technique such as Reverse Auction. The 
penalized cost function for the ^-dimensional] two-dimensional 
problem defines a valley or convex shaped surface which is a 
function of various sets of {u k | k=3, . . . ,M} penalty values and one 
set of assignments for the points in two dimensions. That is, 
for each particular u 3 there is a corresponding [2-dimensional] 
two-dimensional penalized cost function problem and its solution. 
Note that the solution of the r2-dimensional1 two-dimensional 
penalized cost function problem identifies the set of assignments 
for the particular u 3 values that minimize the penalized cost 
function. However, these assignments are not likely to be 
optimum for any higher dimensional problem because they were 
based on an initial arbitrary set of u k values. Therefore, the 
next step is to determine the optimum assignments for the related 
[ 3-dimensional] three-dimensional penalized cost function 
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problem. There exists a r2-dimensionall two-dimensional hill 
shaped function [3> 

u 3 u k |k>3}] 

0 which is a graph of the minimums of all penalized cost 
functions at various sets of assignments in two dimensions. For 
the three-dimensional problem, the function 0 can be defined 
based on the solution to the foregoing two-dimensional penalized 
cost function. By using the current u 3 values and the f u k \ k > 3} 
values originally assigned [. Then], the gradient of the hill- 
shaped [<3> 
u 3 ] 

function 0 is determined, which points toward the peak of the 
hill. By using the gradient and u 3 values previously selected 
for the one point on the hill (corresponding to the minimum of 
the penalized cost [0 
U 3 ] 

function 0 ) as a starting point, the u 3 values can be found for 
which the corresponding problem will result in the peak of the 
[4> 

a. a ] 

function 0. The solution of the corresponding two-dimensional 
problem is the proper values for two of the three sets of indices 
in the three-dimensional problem. These solution indices can 
select a subsection of the cost array which maps to a two- 
dimensional array. The set of indices which minimize the two- 
dimensional assignment problem based on that array corresponds to 
the proper assignment of points in the third dimension. The 
foregoing "recovery" process was known in the prior art, but it 
is modified here to adjust for the sparse matrix characteristic . 
The next task is to recover the solution of the proper u 4 values 
for the r4-dimensionall four-dimensional problem. The foregoing 
hill climbing process will not work again because the foregoing 



31 



hill climbing process when required to locate the [ 4-dimensional ] 
four-dimensional u 4 values for the peak of [O 3 case of <t 3 ] 
0 s requires the exact definition of the function (as was 

available in the case of 0 2 ) or an always less than approximation 
of 0 s , whereas the iteration can result in a greater than 
approximation of [<£ 3 

function i|r a a 
«D 

U k 

gradient of the ijr 
u 4 u 4 ] 

0 s . According to the present invention, another three- 
dimensional function ¥ is defined which is a "less than 
approximation" the three-dimensional function 0 and which can be 
defined based on the solution to the two-dimensional penalized 
cost function and the previously assigned and determined u k 
values. Next, the gradient of the function ¥ is found and hill 
climbing technique used to determine the u 4 values at the peak. 
Each selected u 4 set results in a new [ 3-dimensional ] three- 
dimensional problem and requires the ["2-dimensionall two- 
dimensional hill climbing based upon new [2-dimensional] two- 
dimensional problems. At the peak of the [3-dimensional 
three-dimensional function ¥, the solution values are a subset 
of the values required for the four-dimensional solution. 
Recovery processing extends the subset to a complete solution. 
This process is repeated iteratively until the u k values that 
result in a corresponding solution at the peak of the highest 
order [W $ 
$ ] 

functions ¥ and 0 are found. The final recovery process then 
results in the solution of Jr-dimensional problem. Figure 5 
illustrates process 300 in more detail. 
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Insert the following paragraph before the paragraph beginning at column 1 8, line 47: 



1.2. Problem Formulation 

In problem formulation step 310, all data structures for the 
subsequent steps are allocated and linked by pointers as required 
for execution efficiency. The incoming problem is partitioned as 
described in the subsequent section. This partitioning has the 
effect of dividing the incoming problem into a set of independent 
problems and thus reducing the total workload. The partitioning 
process depends only on the actual cost matrix so the 
partitioning can and is performed for all levels of the 
relaxation process. 

Amend the paragraph beginning at column 18, line 47, as follows: 
1.2.1. Relaxation and Recovery 

Step 320 begins the Lagrangian Relaxation process for 
reducing the Af-dimensional problem by selecting all Lagrangian 
Coefficient u M penalty values initially equal to zero. The 
Lagrangian Coefficients associated with the IVP constraint set 
are [a N M+1 element] an (N M +1 ) -element vector. The reduction of 
this M-dimensional problem in step 322 to a [M-l dimensional] (M- 
1) -dimensional problem uses the two step process described above. 
First, a penalty based on the value of the respective u M 
coefficient is added to the cost function when a point is 
assigned to more than one track and then the resultant cost 
function is minimized. However, during the first iteration, the 
penalty is zero because all u M values are initially set to zero. 
Second, the requirement that no point from any image can be 
assigned to more than one track is relaxed for one of the images. 
In the extreme this would allow a point from the relaxed image to 
be associate with every track. However, the effect of the 
previous penalty would probably mean that such an association 
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would not minimize the cost. The effect of the two steps in 
combination is to remove a hard constraint while adding the 
penalty to the cost function so that it operates like a soft 
constraint. For step 322 this [two step] two-step process 
results in the following penalized cost function problem with 
k=M: 

(a) 3> k (u k ) = Minimize: $ k (u k ,z k ) [[3.2]] (1.5) 



v^v^k k Vvk\^^k 

i,=o i k =o V-^ h-h *k [t^o tT 1 " k 



r ^ k k vK k 

i 1= 0 i k =0 1 l- 1 k *k l V" l k f~o k 



(b) Subject to: 



L =0 i k =0 I k 



(d) 



*L £Li >Lj «t v 

^=0 ij_!=0 ij +1 =0 i k =0 1 k 



for ij = 1, . . .Nj 
and j=2, . . . k-l^ 



{0,1} 



for all i x . 



Because the constraint on single assignment of elements from the 
last image has been eliminated, [a M-l dimensional] an (ftf-D- 
dimensional problem can be developed by eliminating some of the 
possible assignments. As shown in Equations [[3.3]] (1.6) , this 
is done by selecting the smallest cost element from each of the 
iVP axis vectors of the cost matrix. Reduction in this manner 
yields a new, [lower order] lower-order penalized cost function 
defined by Equations r [3.311 (1.6) which has the same minimum cost 
as does the objective function defined by [[3.2 (a) 1 1 (1.5) (a) 
above . 
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Amend the paragraph beginning at column 19, line 41, as follows: 



The cost vectors are selected as follows. Define [an index 
array m li--iH and] a new cost array c*~J t ( by: 

[ [3.3] ] 

k k k 

[m; = Min: arg minimize { c : - u ; |i. =0,1, ...,N t }] 
1 i— 1 k h—h V 

(1-6) 

C tlr c "..i k -^... ik fo ^-A- 1 )Ko,..,o) 

k-l V*v . r_ k k, 

c o,...,o = ij 1111,1 {0 » c 0...0" u i k } 



The resulting [M-l dimensional] (M-l ) -dimensional problem is 
(where k=M) : 

[[3.4]] (1.7) 



, n ^ k-l k-l 

$ k (u K ) = Minimize: v k _ 1 (z lc-1 )= J, ... V C: ; z ; ; 



N, NL 



V*v k-l 

Subject to: 2^-JL z i i =1 ii = 1, . • .N x 

i^O i k =0 l-k 



i,=0 ij +1 =0 i k =0 1 k 



for ij = 1, . . .Nj 
and j=2, . . . k-l^ 



^ ^ k-l , 

2,...!, Zi i =i i.-i = i.-.-n^ 

i,=0 L 2 =0 ^"'Vl 
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Z: : 6 {0,1} for all i x . . .l k .^ 

I k 

Assignment Problem [[3.1]] (1.4) and Problem Formulation [[3.4]] 
(1.7) differ only in the dimension M vs. M-l, respectively. An 
optimal solution to [[3.4]] (1.7) is also an optimal solution to 
equation [[3.2]] (1.5) . This relationship is the basis for an 
iterative sequence of reductions indicated by steps 320-332 
through 330-332 and 200-204 in which the penalized cost function 
problem is reduced to a [two dimensional] two-dimensional 
problem. As these formula will be used to describe the 
processing at all levels, the lowercase k is used except where 
specific reference to the top level is needed. In step 206, the 
[2-dimensional] two-dimensional penalized cost function is solved 
directly by the prior art Reverse Auction technique. Each 
execution of 206 produces two results, the set of z 2 values that 
minimize the problem and the cost that results v 2 when these z 
values are substituted into the objective function [[3.4 (a)]] 
(1.7) (a) . 

Amend the paragraph beginning at column 20, line 37, as follows: 

In step 208, according to the prior art, solution z 2 values 
are substituted into the [2-dimensional] two-dimensional 
derivative of the [<I> 2 ] surface <P ? . The result indicates how the 
value of u 3 should be adjusted so as to perform the hill climbing 
function. As was previously described the objective is to 
produce a sequence of u- values which ends when the u 3 value is 
in the domain of the peak of the [0 1 surface 0. The section 
"Determining Effective Gradient" describes how new values are 
computed and how it is determined that the current u f points 
[ a. a 

u k ] 
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to the peak of & 0 . When no further adjustment is required the 
flow moves to step 214 which will attempt to recover the [3- 
dimensional] three-dimensional solution as previously described. 
When further adjustment is required then the flow progresses to 
step 212 and the new values of u k are computed. At the [2- 
dimensionall two-dimensional level the method of the prior art 
could be used for the hill climbing procedure. However, it is 
not practical to use this prior art hill climbing technique to 
determine the updated Lagrangian Coefficients u k or the Max on 
the next (or any) higher order [O 1 surface <t> because the next 
(or any) higher dimensional function <P cannot be defined based 
on known information. 

Delete the paragraph beginning at column 21, line 1, thru column 21, line 10. 

Amend the paragraph beginning at column 21, line 12, as follows: 

Instead, the present invention defines a new function based 
on known information which is useful for hill climbing from the 
third to the fourth and above dimensions, i.e., u k values which 
result in z values that are closer to the proper z values for the 
highest ^-dimension. This hill climbing process (which is 
different than that used in the prior art of Figure 4 for 
recovering only the [three dimensional] three-dimensional 
solution) is used iteratively at all lower dimensions k of the M- 
dimensional problem (including the [ 3-dimensionall three- 
dimensional level where it replaces prior art) even when k is 
much larger than three. Figure 6 helps to explain this new hill 
climbing technique and illustrates the original ^-dimensional 
cost function of Problem Formulation [[3.1]] (1.4) . However, 
the actual ic-dimensional cost surface v k defined by [[3.1 (a)]] 
(1.4) (a) comprises scalar values at each point described by k- 
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dimensional vectors and as such can not be drawn. Nevertheless, 
for illustration purposes only, Figure 6 ignores the reality of 
ordering vectors and illustrates a concave function v k (z k ) to 
represent Equation [[3.1]] (1.4) . The [ v k ] surface v„ is 
illustrated as being smooth to simplify the explanation although 
actually it can be imagined to be terraced. The goal of the 
assignment problem is to find the values of "z k ; these values 
minimize the ic-dimensional cost function v k . 

Amend the paragraph beginning at column 21, line 32, as follows: 

For purposes of explanation, assume that in Figure 6, k=A 
(the procedure is used for all [k>31 k > 3 ) . This problem is 
reduced by two iterations of Lagrangian Relaxation to a [2- 
dimensional] two-dimensional penalized cost function <f)f . This 
cost function, and all other cost functions described beloWj_ are 
also non-smooth and continuous but are illustrated in Figure 6 as 
smooth for explanation purposes. Solving the <pf problem 
results in one set of z 2 assignments and the value of at 
the point u?j . A series of functions (f) } ^',...,(p^ ^' each generated 
from a different u 3 are shown. The particular series illustrates 
the process of locating the peak of <t> (k „ in . The [2-dimensional ] 
two-dimensional penalized cost functions <f>j ^',...,<p^ ^' can be 
solved directly. Each such solution provides the information 
required to calculate the next u 3 value. Each iteration of the 
hill climbing improves the selection of u 3 values, i.e., yields 
(p 2 problem whose solution is closer to those at the solution of 
the 0 3 problem. The result of solving <f>* ^ is values that are 
on both <P (! r- i; . and <P k \ <P h ] . Figure 6 illustrates the surface <£ ,, 
which comprises the minimums of all if -dimensional penalized cost 
function surfaces 0 ,, , i.e., if the Problem Formulations (1.5) and 
[[3.4]] (1.7) were solved at all possible values of u k the 
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function $ k [ k $ k ] ( u J would result. The 1 surf ace <P k is 

always less than the [v k 1 surface v„ except at the peak as 
described in Equation [[3.5]] (1.8) and its maximum occurs where 
the [v k 1 surface v k is minimum. Because the [$ k <5 k v k the 
surface. The $ k ] $> v represents the minimum [si of the surface & k . 
any point on the surface <P k can mapped to the surface v k . The 
function <P , r provides a lower bound on the minimization problem 
described by [[3.1] (a)] (1.4) (a) . Let ~z k be the unknown 
solution to Problem Formulation [[3.1]] (1.4) and note that: 

[[3.5]] (1.8) 

Consequently, the [z k lvalues z k at the peak of & k (i.e., the 
greatest lower bound on the cost of the relaxed problem) , can be 
substituted into the ^-dimensional penalized cost function to 
determine the proper assignments. Consequently, the present 
invention attempts to find the maximum on the [<3> k ] surf ace & k . 
However, it is not possible to use the prior art hill climbing to 
hill climb to the peak of 0 k because the definition of & k 
requires exact knowledge of lower order [i> ] functions _&. As the 
solution of 0f is not the exact \ the] solution, in that higher 
order [u lvalues of u are not yet optimized, its value can be 
larger than the true peak of 0 k . As such it is not a lower bound 
on v k and it can not be used to recover the required solution. 

Amend the paragraph beginning at column 22, line 7, as follows: 

Instead, the present invention defines all auxiliary 
functions W k which [is] are based only on the solution to the [2- 
dimensional] two-dimensional penalized cost function problem, 
lower order values z k and values [and ] u k [values] determined 
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previously by the reduction process. The [W k ] function W k is a 
less than approximation of 0 k , and its gradient is used for hill 
climbing to its peak. The [z k ] values z k at the peak of the [W k ] 
function W y are then substituted into Problem Formulation [[3.2]] 
(1.5) to determine the proper assignments. To define the [¥ k 
] function_^, the present invention explicitly makes the function 
<t> k {u k ) a function of all higher order sets of Lagrangian 
Coefficients with the expanded notation: [$ k U k u k+1 u k W] ( u k ; 
u k+1 , . . . , u k ) . Then, a new set of functions W, is defined 
recursively, using the [<t k ] @ ^ s domain: 



where v 2 is the solution value for the most recent [2- 
dimensional] two-dimensional penalized cost function problem. 
For rk>31 ^ > 3 



[ [3.6] (a) ] (1.9) 




[ [3.6] (b) ] (1.10) 



<S> k {u k ;u k+l ,...,u K ), 



if known, 



x ? k {u z ,...,u k \u k )= 



^ k _ l (u\...,u k - 1 ;u k - ] 




otherwise. 
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From the definitions of <P k M and v„ (Problem Formulation (1.7) 
compared with Problem Formulation [[3.2]] (1.5) ) : 

* k (u k ni k+1 > ...,u M )=v k _ 1 (z k - 1 ) + £uj C 

i k =0 k 

it follows that: 




and with that Equation [3.5] (1.8) is extended to: 

Y k (u 3 ,...,u k - 1 ;u k )£ $ k (u k ;u k+1 ,...,u M )<; v^u*) 

[[3.7]] (1.11) 

This relationship means that either <P k or ¥ k may be used in hill 
climbing to update the Lagrangian Coefficients u. @ k is the 
preferred choice, however it is only available when the solution 
to Problem Formulation [[3.2]] (1.5) is a feasible solution to 
Problem Formulation [[3.1]] (1.4) (as in hill climbing from the 
second to third dimension which is why prior art worked) . For 
simplicity in implementation, the function W k is defined so that 
it equals [<£>] & v when either function could be used. It is 
therefore always used, even for hill climbing from the second 
dimension. The use of the [¥ 1 function ¥ which is based on 
previously assigned or determined u values and not higher order u 
values which are not vet -determined, is an important feature of 
the present invention. 

Delete the paragraph beginning at column 23, line 1, thru column 23, line 14. 

Amend the paragraph beginning at column 23, line 15, as follows: 

1.2.2. Determining Effective Gradient 
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After the function ¥ k is defined, the next steps of hill 
climbing/peak detection are to determine the gradient of the [W k 
] function ¥ b r determine an increasing portion of the gradient and 
then move up the [¥ k 1 surf ace ¥ y in the direction of this 
increasing portion of the gradient. As shown in Figure 6, any 
upward step on the [W k the ^ kj U k a a] surface ¥ * . for example, to 
the minimum of the i> k i will yield a new set of values u k (to the 
"left") that is closer to the ideal set of values u k \ values] 
which correspond to the minimum of the [v k ] function v„. While 
it is possible to iteratively step up this [¥ k 1 surface ¥ k with 
steps of fixed size and then determine if the peak has been 
reached, the present invention optimizes this process by 
determining the single step size from the starting point at the 
minimum of [<p ki ]4?. that will jump to the peak and then 
[calculating] calculate the values u k [ values] at the peak. Once 
the [f."u" si values u at the peak [at ] of ¥ k are determined, then 
the values u k [ values] can be substituted into Problem 
Formulation [[3.2]] (1.5) to determine the proper assignment. 
(However, in a more realistic example, where k is much greater 
than three, then the values u k [ values] at the peak of the [W 
1 function ¥ along with the [lower order] lower-order values u k [ 
values] and those assigned and yielded by the reduction steps are 
used to define the next higher level function ¥. This 
definition of a higher order function ¥ and hill climbing 
process are repeated iteratively until ¥ v , the peak of ¥ ,,, and the 
values u k at the peak of W k are identified.) The following is a 
description of how to determine the gradient of each [¥ 1 surface 
¥ and how to determine the single step size to jump to the peak 
from the starting point on each surface ¥. 

Delete the paragraph beginning at column 23, line 32, thru column 23, line 54. 
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Amend the paragraph beginning at column 23, line 55, as follows: 

As noted above, each surface ¥ is non-smooth. Therefore, 
if a gradient was taken at a single point, the gradient may not 
point toward the peak. Therefore, several gradients (a "bundle" ) 
are determined at several points on the [¥ k ] surface W k in the 
region of the starting point (i.e., minimum of 0 k .) and then 
averaged. Statistically, the averaged result should point toward 
the peak of the [¥ k 1 surf ace W k . Wolfe's Conjugate Subgradient 
Algorithm ( [Wolfe75, Wolfe791 P. Wolfe. A method of conjugate 
subgradients for minimizing non-dif f erentiable functions. 
Mathematical Programming Study, 3:145-173, 1975; P. Wolfe. 
Finding the nearest point in a polytope. Mathematical Programming 
Study, 11:128-149, 1976 ) for minimization was previously known in 
another environment to determine a gradient of a non-smooth 
surface using multiple subgradients and can be used with 
modification in the present invention. [Wolfe's algorithm is 
further described in "A Method of Conjugate Subgradients for 
Minimizing Nondiff erentiable Functions" page 147-173 published by 
Mathematical Programming Study 3 in 1975 and "Finding the Nearest 
Point in a Polytope" page 128-149 published by Mathematical 
Programming Study 11 in 1976. ] The modification to Wolfe's 
algorithm uses the information generated for W k (u k3 , . . . , u kk ~ 2 ; u kk_1 ) 
as the basis for calculating the subgradients. The definition of 
a subgradient v of W k (u k3 , . . . , u kk ) is any member of the 
subdif f erential set defined as: 

[5¥ k (u)={veR N * +1 | (¥ k (u k3 , . . . f u^-S-u') -¥ k (u k3 , . . . , 
u k " x ;u k ) ) >v T (u'-u k ) V u'eR^ 1 }] 

<7g Wu)={v E R N * +1 |(^(u k3 u kk - 1 ;u')-SUu k3 u"' 1 .-^) ) 

>v r (u'-u k ) V u'e pA +1 }, 
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[ (where v T is the transpose of v) 1 where v T is the transpose 

of v. 

Next, a subgradient vector is determined from this function. 
If z k is the solution of Problem Formulation f f 3 1 (1 . 5) , then 
differentiating W k (u 3 , . . . , u k-1 ; u k ) with respect to u k k and 
evaluating the result with respect to the current selection 
matrix z k yields a subgradient vector: 

g=(o,(i-£...£ Zi i |i k =i,...,N k )) 

i 1= 0 ^.,=0 1'" k 

Amend the paragraph beginning at column 24, line 19, as follows: 

The iterative nature of the solution process at each 
dimension yields a set of such subgradients . Except for a 
situation described below.,, where the resultant averaged gradient 
does not point toward the peak, the most recent set of such 
subgradients are saved and used as the "bundle" for the peak 
finding process for this dimension. For example, at the [k] 
level k there is a bundle of subgradients of the [W k ] surface W k 
near the minimum of the [c}) ki ] surf ace ^.._determined as a result 
of solving Problem Formulation f T 3 . 1 1 1 (1.4) at all lower levels. 
This bundle can be averaged to approximate the gradient. 
Alternately, the previous bundle can be discarded so as to use 
the new value to initiate a new bundle. This choice provides a 
way to adjust the process to differing classes of problems, i.e., 
when data is being derived from two sensors and the relaxation 
proceeds from data derived from one sensor to the other then the 
prior relaxation data for the first sensor could be detrimental 
to performance on the second sensors data. 
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Amend the paragraph beginning at column 24, line 37, as follows: 

1.2.3. Step Size and Termination Criterion 
After the average gradient of the [¥ k ] surface W*. is 
determined, the next step is to determine a single step that will 
jump to the peak of the [¥ k 1 surf ace W v . The basic strategy is 
[to 1 first to specify an arbitrary step size, and then calculate 
the value of W k at this step size in the direction of the 
gradient. If the [W k lvalue of W k is larger than the previous 
one, this probably means that the step has not yet reached the 
peak. Conseguently, the step size is doubled and a new [W k 
lvalue of W y is determined and compared to the previous one. 
This process is repeated until the new [W k lvalue of W v is less 
than the previous one. At that time, the step has gone too far 
and crossed over the peak. Conseguently, the last doubling is 
rolled-back and that step size is used for the iteration. If the 
initial estimated W k is less than previous value then the step 
size is decreased by 50%. If this still results in a smaller [W k 
lvalue of W ». then the last step is rolled back and the previous 
step size is decreased by 25%. The following is a more detailed 
description of this process. 

Amend the paragraph beginning at column 24, line 51, as follows: 

With a suitable bundle of subgradients determined as just 
described [. ]j_ Wolfe's algorithm can be used to determine the 
effective subgradient [(d)] d and the [Upqradedl upgraded value 
Uj +1 . From the previous iteration, or from an initial condition, 
there exists a step length value [ ( t) ] t. The value, 
u + = u y - + td 

is calculated as an estimate of Uj +1 . To determine if the current 
step size is valid [the] we evaluate W k (u 3 , . . . , u k_2 ; u + ) . If the 
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result represents an improvement then we double the step size. 
Otherwise we halve the step size. In either case a new u + is 
calculated. The doubling or halving continues until the step 
becomes too large to improve the result, or until it becomes 
small enough to not degrade the result. The resulting suitable 
step size is saved with d as part of the subgradient bundle. The 
last acceptable u + is assigned to u k +1 . 

Amend the paragraph beginning at column 25, line 1, as follows: 

Three distinct [criterion! criteria are used to determine 
when Uj is close enough to u k : 

1. The Wolfe's algorithm criterion of d=0 given that the test 
has been repeated with the bundle containing only the most 
recent subgradient. 

2. The difference between the lower bound <I> k (u k ) and the upper 
bound v k (z k , u k ) being less than a preset relative threshold. 
(Six percent was found to be an effective threshold for 
radar tracking problems.) 

3. An iteration count being exceeded. 

Amend the paragraph beginning at column 25, line 1 1, as follows: 

The use of limits on the iteration are particularly 
effective for iterations at the level 3 through ±n-l [ levels,]! 
as these iterations will be repeated so as to resolve higher 
order coefficient sets. With limited iterations the process is 
in general robust enough to improve the estimate of upper order 
Lagrangian Coefficients. By limiting the iteration counts then 
the total processing time for the algorithm becomes 
deterministic. That characteristic means the process can be 
effective for real time problems such as radar, where the results 
of the last scan of the environment must be processed prior to 
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the next scan being received. 

Amend the paragraph beginning at column 25, line 22, as follows: 

1.2.4. Solution Recovery 

The following process determines if the u k values at what is 
believed to be the peak of the [W k ] function W k adequately 
approximate the u k values at the peak of the corresponding [<t> k 
1 function & k . This is done by determining if the corresponding 
penalized cost function is minimized. Thus, the u k values at the 
peak of the [.W k ] function ¥„ are first substituted into Problem 
Formulation [ [3.21 1 (1.5) to determine a set of z assignments for 
k-1 points. During the foregoing reduction process, Problem 
Formulation [ [3. 41 1 (1.7) yielded a tentative list of k selected z 
points that can be described by their indices as: 

'•{(*! ■"4-l)}jlvi^"' f *" 1 )l/=i ' where N ° is the number of cost elements 
selected into the solution. One possible solution of Problem 
Formulation [ [3. 11 1 (1.4) is the solution of Problem Formulation 
["[3.211 (1.5) which is described 

as[{(rj...r 1 k _ 1 m^ ^ ^) } J^j]^*!— **- i m *.../ J ^ 1 with m t-i k , as i1: was defined 
in Problem Formulation \ \ 3 . 31 1 ( 1 . 67" . If this solution satisfies 
the [k-th]£ff constraint set^. then it is the optimal solution. 

Amend the paragraph beginning at column 25, line 39, as follows: 

However, if the solution for Problem Formulation 
f r 3 . 2 1 1 (1.5) is not feasible (decision 355), then the following 
adjustment process determines if a solution exists which 
satisfies the [k-th]^ constraint while retaining the 
assignments made in solving Problem Formulation [ [3.41 1 (1.7) . To 
do this, a [2-dimensionall two-dimensional cost matrix is defined 
based upon all observations from the [k-th] Jcf! set which could be 
used to extend the relaxed solution [.] j_ 
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[ [3.8] ] 



k for /=0,...^ 

n ji and j=0,...Jf 0 . (1.12) 

If the resulting r2-dimensionall two-dimensional assignment 
problem, 



[3.9] ] 



Minimize [:] zlzl h f i w ,i 

j=0 1=0 

Subject to: 2J W 7 7 =1 j=l,...,N 0J _ 



/=0 



w y/ e 10,lt j=0,...,N 0 , 1=0,..., N k 

has a feasible solution^ then the indices of that solution map to 
the solution of Problem Formulation f T 3 . X 1 1 (1.4) for the k- 
dimensional problem. The first index in each resultant solution 
entry is the pointer back to an element of the j|j...zj(_ 1 m i . . jj^ 0 
list. That element supplies the first k-1 indices of the 
solution. The second index of the solution to the recovery 
problem is the k th index of the solution. Together these indexes 
specify the values of z k that solve Problem Formulation 
[ f 3 . Ill (1.4) at the k th level. 

Amend the paragraph beginning at column 26, line 8, as follows: 

If Problem Formulation \ \3 . 91 1 (1.13) does not have a 
feasible solution^ then the value of u£ which was thought to 
represent u£ is not representative of the actual peak and further 
iteration at the k th level is required. This decision represent 
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the branch path from step 214 and equivalent steps. 

Amend the paragraph beginning at column 26, line 24, as follows: 

In partitioning to groups no consideration is given to the 
actual cost values. The analysis depends strictly on the basis 
of two or more cost elements sharing the same specific axis of 
the cost matrix. In a r2-dimensional 1 two-dimensional case two 
cost elements must be in the same group if they share a row or a 
column. If the two elements are in the same row, then each other 
cost element that is also in the same row, as well as any cost 
elements that are in columns occupied by members of the row must 
be included in the group. The process continues recursively. In 
literature it is referred to as "Constructing a Spanning Forest." 
The ic-dimensional case is analogous to the [2-dimensionall two- 
dimensional case. The specific method we have incorporated is a 
depth first search, presented by Aho, Hopecraft, and Ullman (A.V. 
Aho , [in "1 J.E. Hopcroft, and J.D. Ullman. Design and Analysis of 
Computer Algorithms [, " section 5.2, published by Addison- 
Westlevl . Addison-Wesley , M A, 1974) . 

Amend the paragraph beginning at column 26, line 47, as follows: 

The result of partitioning at level M is the set of problems 
described as { P ±j | i=l , . . . ,p j and j=l,...,N}, where N is the total 
number of hypothesis. The problems labeled [ { P ±j | i=l , . . . , p i and 
j=l,...,N}] { P n \ i=l, . . . , p x } are the cases where [their] there is 
only one choice for the next observation at each scan and that 
observation could be used for no other track, i.e., it is a 
single isolated track. The hypothesis must be included in the 
solution set and no further processing is required. 
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Amend the paragraph beginning at column 26, line 48, as follows: 



As [hypothesis] hypotheses are constructed the first element 
is used to refer to the track [id]ID. Any problem in the 
partitioned set which does not have shared costs in the first 
scan represent a case where a track could be extended in several 
ways but none of the ways share an observation with any other 
track. The required solution hypothesis for this case is the 
particular hypothesis with the maximum likelihood. For this case 
all likelihoods are determined as was described in Scoring and 
the maximum is selected. 

Amend the paragraph beginning at column 26, line 57, as follows: 

In addition to partitioning at the [M ] level M, 

partitioning is applied to each subsequent level M-l,...,2. For 
each problem that was not eliminated by [either by ] the prior 
selection^ partitioning is repeated, ignoring observations that 
are shared in the last set of observations. Partitioning 
recognizes that relaxation will eliminate the last constraint set 
and thus partitioning is feasible for the lower level problems 
that will result from relaxation. This process is repeated for 
all levels down to k=3 . The full set of partitionings can be 
performed in the Problem Formulation Step 310, prior to 
initiating the actual relaxation steps. The actual [2- 
dimensionall two-dimensional solver used in step 206 includes an 
equivalent process so no advantage would be gained by 
partitioning at the k=2 level. 

Amend the paragraph beginning at column 27, line 4, as follows: 

There are two possible solution methods for the remaining 
problems. "Branch and Bound" as was previously described, or the 
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relaxation method that this invention describes. If any of the 
partitions have 5-10 possible tracks and less than 50 to 20 
hypotheses, then the prior art "Branch and Bound" algorithm 
generally executes faster than does the relaxation due to its 
reduced level of startup overhead. The "Branch and Bound" 
algorithm is executed against all remaining M level problems that 
satisfy the size constraint. For the remainder the Relaxation 
algorithm is used. The scheduling done in Problem Formulation 
allows each Problem Formulation \ \3 . 21 1 (1.5) cost matrix 
resulting from the first step of relaxation to be partitioned. 
The resulting partitions can be solved by any of the four 
methods isolated track direct inclusion, isolated track tree 

evaluation, small group "Branch and Bound" or an additional stage 
of relaxation as has been fully described. 

Amend the paragraph beginning at column 27, line 29, as follows: 

The following is a more detailed description of the 
partitioning method. Its application at all but the [M 1 level M 
depends upon the relaxation process described in this invention. 
The recursive partitioning is therefore a distinct part of this 
invention. The advantage of this method is greatly enhanced by 
the sparse cost matrix resulting from tracking problems. However 
the sparse nature of the problem requires special storage and 
search techniques. 

Amend the paragraph beginning at column 27, line 37, as follows: 

A hypothesis is the combination of the cost element c n the 
selection variable z n and all observations that made up the 
potential track extension. It can be written as, 
[h n ={c n , z n , {o nk =o k . |k=l, . . . ,Mi 6 { 1, . . . ,N k } } } ] 

h n =\ c n ,z n ,{ o Pk =o kl | k=l , . . . ,M i g { 1 , . . . , N k } } } , i.e., cost, selection 
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variable and observations in the hypothesis. \nE{ 1, . . . , N] 1 Here n 
E { 1 , . . . , N} , where N is the total number of hypotheses in the 
problem. While the cost and assignment matrices were previously 
referenced, these matrices are not effective storage mechanisms 
for tracking applications. Instead the list of all hypothesis 
and sets of lists for each dimension that reference the 
hypothesis set are stored. The hypothetical set in list form is: 

For each dimension f k=l 1 k=l , . . ._JVf_ there exists a set of lists, 
with each list element being a pointer to a particular 
hypothesis : 

T s n 1 xt i i=N t ,k=M 

where N k . is_a number of hypothesis containing the [i-th] i th 
observation from scan k. This structure is a multiply linked 
list in that any observation is associated with a set of pointer 
to all hypothesis it participates in, and any hypothesis has a 
set of pointers to all observations that formed it. (These 
pointers can be implemented as true pointers or indices depending 
upon the particular programming language utilized. ) 

Amend the paragraph beginning at column 27, line 62, as follows: 

Given this description of the matrix storage technique then 
the partitioning technique is as follows: Mark the first list L k . 
and follow out all pointers in that list to the indicated 
hypothesis h Pk . for i=l , . . . , [N kl ] N k . Mark all located 
hypothesis, and for each follow pointers back the particular 
[L ok ]L k for k=l,...j_M. Those L's if not previously marked get 
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marked and also followed out to hypothesis elements and back to 
I/'s. When all such L's or h's being located are marked, then an 
isolated sub-problem has been identified. All marked elements 
can be removed from the lists and stored as a unique problem to 
be solved. The partitioning problem then continues by again 
starting at the first residual [L 1 set L. When none remain, the 
original problem is completely partitioned. 

Amend the paragraph beginning at column 28, line 1 1, as follows: 

Isolated problems can result from one source track having 
multiple possible extensions or from a set of source tracks 
contending for some observations. Because one of the indices of 
k (in our implementation it is k=l) [indicate] indicates the 
source track then it is possible to categorize the two problem 
types by observing if the isolated problem includes more than one 
L-list from the index level associated with tracks. 

Amend the paragraph beginning at column 28, line 62, as follows: 

Based on the foregoing, apparatus and methods have been 
disclosed for tracking objects. However, numerous modifications 
and substitutions can be made without deviating from the scope of 
the present invention. For example, the foregoing [¥ ] functions 
¥ can also be defined as recursive approximation problem in 
which several values of higher order u k values are used to 
eliminate the higher than approximation characteristic of the [<£ k 

W 

$ k ] 

function &„. The hill climbing of the function W can be 
implemented by a high order hill climbing using the enhanced 
function <P„. Although the result would not be as efficient it 
seems likely that the method would converge. Therefore, the 



53 



invention has been disclosed by way of example and not 
limitation, and reference should be made to the following claims 
to determine the scope of the present invention. 

Amend the paragraph beginning at column 29, line 25, as follows: 

II. 1. Formulation of the Assignment Problem 

The goal of this section is to explain the formulation of 
the data association problems, and more particularly multi- 
dimensional assignment problems, that govern large classes of 
problems in centralized or hybrid centralized-sensor level 
multisensor/multitarget tracking. The presentation is brief; 
technical details are presented for both track initiation and 
maintenance in J.A.B. Poore[, ] ^_ [Multi-dimensional] 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor data 
fusion [, ] ^Computational Optimization and Applications , 3[ 
(1994), pp. 1 : 27-57 , 1994 ) for [nonmaneuvering] non-maneuvering 
targets and in [Ingemar J. Cox, Pierre Hansen, and Beta Julesz, 
eds., Partitioning Data Sets, 1 (A.B. Poore. Multidimensional 
assignments and multitarget tracking: Partitioning data sets. In 
P. Hansen, I.J. Cox, and B. Julesz, editors, DIMACS Series in 
Discrete Mathematics and Theoretical Computer Science , volume 19, 
pages 169-198, Providence, R.I., 1995 . American Mathematical 
Society[, Providence, R.I., v. 19, Feb. 1995, pp. 169-198]! for 
maneuvering targets. Note that the present formulation can also 
be modified to include target features (e.g., size and type) into 
the scoring process 154. 

Amend the paragraph beginning at column 29, line 43, as follows: 

The data assignment problems for multisensor and multitarget 
tracking considered here are generally posed as that of 
maximizing the posterior probability of the surveillance region 

54 



(given the data) according to 

[[5.1]] 



nize totli 
[P(T=y 0 \: 



Maximize < r ^ Y 1 Z ^ lye T*\, (2A) 
\ — 0| Z ^ lf I' 



where Z M represents M data sets, y is a partition of indices of 
the data (and thus induces a partition of the data) , r* is the 
finite collection of all such partitions, [1 *y°] r is a discrete 
random element defined on r*, v° is a reference partition, and 
[P(T=y|z m )] P(r=v\z M ) is the posterior probability of a partition 
Y being true given the data Z u . The term partition is defined 
below. 

Amend the paragraph beginning at column 29, line 59, as follows: 

Consider M observation sets Z(k) (k=l, . . . , N) each of N k 
k N 

observations {z- } . k , , and let Z M denote the cumulative data 



set defined by 



k N 

Z(k) = {x- } . * and Z M = { Z ( 1 ),..., Z (M) } , 



[5.2] 



Z(k) = ^ and Z m = {Z(1),...,Z(M)}, Q2} 



respectively. In multisensor data fusion and multitarget 
tracking the data sets Z(k) may represent different classes of 
objects, and each data set can arise from different sensors. For 
track initiation the objects are measurements that must be 
partitioned into tracks and false alarms. In the formulation of 
track extensions a moving window over time of observations sets 
is used. The observation sets will be measurements which are: 
(a) assigned to existing tracks, (b) designated as false 
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measurements, or (c) used for initiating tracks. However, note 
that alternative data objects instead of observation sets may 
also be fused such as in sensor level tracking wherein each 
sensor forms tracks from its own measurements and then the tracks 
from the sensors are fused in a central location. Note that, as 
one skilled in the art will appreciate, both embodiments of the 
present invention may be used for this type of data fusion. 

Amend the paragraph beginning at column 30, line 14, as follows: 

The data assignment problem considered presently is 
represented as a case of set partitioning defined in the 
following way. First, for notational convenience in representing 
tracks, a zero index is added to each of the index sets in 
r [5.21 1 (2.2) , a gap filler z k 0 is added to each of the data sets 
Z(k) in r T5.21 1 (2.2) , and a "track of data" is defined as (^,...^) 
_j_ where i k [and z k ] can now assume the values of 0[ and z, 
respectively] . A partition of the data will refer to a 
collection of tracks of data or track extensions wherein each 
observation occurs exactly once in one of the tracks of data and 
such that all data is used up. Note that the occurrence of the 
gap filler is unrestricted. The gap filler z k 0 serves several 
purposes in the representation of missing data, false 
observations, initiating tracks, and terminating tracks. Note 
that a "reference partition" may be defined which is a partition 
in which all observations are declared to be false. 

Amend the paragraph beginning at column 30, line 3 1 , as follows: 

Next under appropriate independence assumptions it can be 
shown that: 

[[5.3]] 
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P(T=y\Z M ) _ 
P(T = y°\Z M ) 



V 11 L i 



03) 



where L^,^ is a likelihood ratio containing probabilities for 
detection, maneuvers, and termination as well as probability 
density functions for measurement errors, track initiation and 
termination. Then if [c£. i =-ln(L^ 1 u ) ] 
c k ±1 . . . -ln(L^ . . . iM L, 

[ [5.4] ] 



-In 



P(T = y\Z M ) 



P(T = y 0 |Z m j 



Delete the paragraph beginning at column 30, line 48, thru column 31, line 18, and replace it with 
the following new paragraph: 

Using (2.3) and the zero-one variable z k ±1 _ _ _ ,■ „=! if (± l r . . . , j M ) e y 
and 0 otherwise, one can then write the problem (2.1) as the 
following M-dimensional assignment problem (as also presented in 
section Problem Formulation (1.4) with k=M) : 
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Minimize 22 -X, c i i z i i 

h =0 1 M 1 M 

Subject to: z2 -22 \.i u =l> in = 1 N -| , 



(2.5) 



for i „ = 1 N „ and k=2 M-l, 

22 - 12 \ ^=1, 1m = lr--.rN M 

ii=0 i M -!=0 1 



iel \..i M e for all i , i M 

where c n ... 0 is arbitrarily defined to be zero. Here, each group 
of sums in the constraints (2 . 5) (b) - (2 . 5) (e) represents the fact 
that each non-gap filler observation occurs exactly once in a 
"track of data." One can modify this formulation to include 
multiassignments of one, some, or all the actual observations. 
The assignment problem (2.5) is changed accordingly. For 
example, if is to be assigned no more than, exactly, or no 
less than n k < k times, then the "=1" in the appropriate one of the 
constraints [ 5 . 5 1 (b) - \ 5 . 5 1 (d) is changed to "<, =, > n f k ." 
respectively. 

Amend the paragraph beginning at column 31, line 19, as follows: 

Expressions for the likelihood ratios i^...^/" such as [5.5] 
1 appearing in the costs c^.^-ML.^ ^are [well known well-known . 
In particular, discussions of these ratios may be found in [ : ] 
1A.B. Poore [ , ]_j_[Multi dimensional] Multi-dimensional assignment 
formulation of data association problems arising from multitarget 
tracking and multisensor data fusion, Computational Optimization 
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and Applications [ , 3 (1994) , pp. 27-57; and Ingemar J. Cox, 
Pierre Hansen, and Beta Julesz , eds . , Partitioning Data Sets, ]_,_ 
3:27-57, 1994; A.B. Poore. Multidimensional assignments and 
multitarget tracking: Partitioning data sets. In P. Hansen, 
I.J. Cox, B. Julesz, editors, DIMACS Series in Discrete 
Mathematics and Theoretical Computer Scienc e, volume 19, pages 
169-198, Providence, R.I., 1995 . American Mathematical Society [, 
Providence, R]J_. [I., v. 19, 1995, pp. 169-198. ] Furthermore, the 
likelihood ratios are easily modified to include target features 
and to account for different sensor types. Also note that in 
track initiation, the M observation sets provide observations 
from M sensors, possibly all the same. Additionally note that 
for track maintenance, a sliding window of M observation sets and 
one data set containing established tracks may be used. In this 
latter case, the formulation is the same as above except that the 
dimension of the assignment problem is now M+l. 

Amend the paragraph beginning at column 3 1 , line 41 , as follows: 

Having formulated an M-dimensional assignment problem 
f [5 . 51 1 (2 . 5) , we now turn to a description of the Lagrangian 
relaxation algorithm. Subsection II. 2.1 below presents many of 
the relaxation properties associated with the relaxation of an n- 
dimensional assignment problem to an m -dimensional one via a 
Lagrangian relaxation of n-m sets of constraints wherein \m<] m < 
n < M and preferably in the present invention embodiment [n- 
m>ll n-m >1 . Although any n-m constraint sets can be relaxed, the 
description here is based on relaxing the last n-m sets of 
constraints and keeping the first m sets. Given either an 
optimal or suboptimal solution of the relaxed problem, a 
technique for recovering a feasible solution of the 
n-dimensional problem is presented in subsection II. 2. 2 below and 
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an overview of the Lagrangian relaxation algorithm is given in 
subsection II. 2. 3. 



Amend the paragraph beginning at column 31, line 56, as follows: 

The following notation will be used throughout the remainder 
of the work. Let M be an integer such that [M>31 M >3 and let 
n€{3,...,M}. The n-dimensional assignment problem is 

[ [6.1] ] 



(a) Minimize: v n (z) = 



2j-2j«i 1 ... i /i 1 ...i n 



(b) Subject to[: ] 
(c) 



i,=0 i k _ r 0 i k+1 =0 i n =0 1 " n 



for i k = l,...,N k and k=2,...,n-l, 



i r 0 ^.,=0 I n 



• /N„, 



e {0,1} for all i lf . 



To ensure that a feasible solution of [ \ 6 . 1 1 1 (2.6) always exists, 
all variables with exactly one nonzero index (i.e., variables of 
the form z n 0 . . . oik0 . . . 0 for i k *0) are assumed free to be assigned 
and the corresponding cost coefficients are well-defined. 
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Amend the paragraph beginning at column 32, line 23, as follows: 



The n-dimensional assignment problem [[6.111 (2.6) has n sets 
of constraints. A (2^+1) -dimensional multiplier vector 
associated with the [k-th]Jc^ constraint set will be denoted by 
u k =(u k 0 ,u k , . . . ,u k Hk ) 1 with u k 0 =0 and k=l,...,n. The n-dimensional 
assignment problem [[6.111 (2.6) is relaxed to an m-dimensional 
assignment problem by incorporating n-m of the n sets of 
constraints into the objective function [ [6. 1 (a) 1 1 (2.6) (a) . 
Although any constraint set can be relaxed, the description of 
the relaxation procedure for [[6.111 (2.6) will be based on the 
relaxation of the last n-m sets of constraints. The relaxed 
problem is 

$mn(u m+1 , . . . ,u n ) = Minimize § mn ( z n ; u m+1 , . . . , u n ) [ [6.21 1 (2.7) 





*2=0 i B =0 



= 1, 




for i k = 1, . . . , 



N k and k=2, . 



n 



i e {0,1} 



for all i-L, . 



wherein we have added the multiplier Uq=0 for notational 
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convenience. Thus, the multiplier u k eK Nk+1 with ug=0 is fixed. 



Amend the paragraph beginning at column 32, line 62, as follows: 

An optimal (or suboptimal) solution of [ [6.21 1 (2.7) can be 
constructed from that of an m-dimensional assignment problem. To 
show this, define for each (i 2 ,...,i m ) an index ( j m+1 , . . . , j n ) = 
(jm+i (^1/ • • • ri-m) t • • • t Jn^ir • • • r i- m ) ) ancl a n © w cost function c™ I ___ im by 



smallest such j m+1 , amongst those (n-m) -tuples with the same j m+1 
choose the smallest j m+2r etc., so that {j m+1 ,...,j n ) is uniquely 
defined. ) Using the cost coefficients defined in this way, the 
following m-dimensional assignment problem is [obtained] 
obtained : 

@mn ( u m+1 , . . . ,u n ) = Minimize @ mn {z m ;u m+1 , . . . ,u n ) = v m {z m ) 
Please replace the paragraph beginning on page 85, line 7, 
with the following amended paragraph: 



[ [6.3] 1 (2.8) 



[If (in,,i iJl If (i, 



j_ n ) is not unique, choose the 



r r 6 . 4 1 1 (2.9) 



$ mn (u m+1 , . . . , 



u n ) = Minimize $ mn ( z m ; u m+1 , . . . , u 11 ) = v m (z m ) 




Subject to: 





for i k = 1, . . . ,N k and k=2, . 



,m-l, 
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z- . e {0,1} for all ± lf . . .,i m . 

As an aside, observe that any feasible solution z n of 
r T6. 11 1 (2.6) yields a feasible solution z m of f T6. 41 1 (2.9) via 
the construction 

Z T i = I 1 ^ Z ^" i n-l i n = 1 SOmC ^'"'^ 

v " m [0 otherwise. 

Thus, the m-dimensional assignment problem ["[6.411 (2.9) has at 
least as many feasible solutions of the constraints as the 
original problem [[6.111 (2.6) . 

Amend the paragraph beginning at column 33, line 51, as follows: 

The following Fact A. 2 has been shown to be true. It states 
that an optimal solution of Problem Formulation [ [6.21 1 (2.7) can 
be computed from that of Problem Formulation [[6.411 (2.9) . 
Furthermore, the converse to this fact is provided in Fact A. 3. 
Moreover, if the solution of either of these two problems 
[ r 6 . 4 1 1 (2.9) or r f 6 . 4 1 1 (2.9) is e-optimal (i.e., the objective 
function associated with the suboptimal solution is within "E" of 
the objective function associated with the optimal solution), 
then so is the other. 

Amend the paragraph beginning at column 33, line 60, as follows: 

Fact A. 2. Let vf 1 be a feasible solution to problem 
r r 6 . 4 1 1 (2.9) and define w" by 

[6.5] ] 

Wij.-.i^w?,...^ if d m +i, ■ ■ .i n ) = (j m+ i, • • • j n ) and 
(i 2/ . ..,i m )*(0, . . .,0) 
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=0 if (i a+1 , ■ . .i n ) * (j m+ i, ■ ■ ■ in) and (2. 10) 

(i 2 , . . . ,i m ) * (0, . . . ,0) 

wS...oi m+1 ...i n =l if c8... 01m+1 ... in + £ <0 

k=m+l k 



,... in =0 if cS... 0iB+I ... in + £ ii* 



Then w" is a feasible solution of the Lagrangian relaxed problem 
[ [6.2] 1 (2.7) and 



(f> mn (w n ;u m+1 , . . . ,u n ) 



(p^w ,u ,...,u ; Z^ k=m+1 2^ ik= o u i k 



If, in addition, w™ is optimal for [ \6. 41 1 (2.9) , then w" is an 

optimal solution of \ T6.21 1 (2.7) and 

<D mn (u m+1 ,...,U n ) = 4> (u Bi+ \...,U a )-Y l ? ^^U^ . 

' J ' ' ; z ^k=m+l z ^i k =0 i k 



Amend the paragraph beginning at column 34, line 25, as follows: 

Fact A. 3. Let w" be a feasible solution to problem 
r r 6 . 2 1 1 (2.7) and define vf by 

[ [6.6] 1 (2.11) 



_ w?,...^ for (i,,. . .,ij*(0, . . .,0), 



wj... 0 =0 if (i lf . . .,i m ) = (0, . . .,0) and 

c o...oi m+1 ...i n + £ 14 >0 for all (i m+1 , . . . , i n ) 
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wS... 0 =l if di, . . . , ij = (0, . . . , 0) and 

c S...oi m+1 ...i n + £ <0 for some ( i ra+1 , . . . , i n ) . 

k=m + l k 

Then / is a feasible solution of the problem [ \6. 41 1 (2.9) and 
0 mn ( w° ; u m+1 ,u n ) > $Jy» m ;u m+ \...,u ")- £ u- 

If, in addition, w° is optimal for [[6.211 (2.7) , then w" 1 is an 
optimal solution of [ f6. 41 1 (2.9) , 

^ <wn;U "*' u °» " *~(-^"*'.-.-°)-E^ mtl E^ 0 uf i , and 

Amend the paragraph beginning at column 34, line 52, as follows: 

The next objective is to explain a recovery procedure or 
method for recovering a solution to the n-dimensional problem of 
[T6.111 (2.6) from a relaxed problem having potentially 
substantially fewer dimensions than [[6.111 (2.6) . Note that this 
aspect of the alternative embodiment of the present invention is 
substantially different from the method disclosed in the first 
embodiment of the [multi dimensional] multi-dimensional 
assignment solving process of section 1.1 of this specification. 
Further, this alternative embodiment provides substantial 
benefits in terms of computational efficiency and accuracy over 
the first embodiment, as will be discussed. Thus, given a 
feasible (optimal or suboptimal) solution of [76.411 (2.9) (or 
w° if Problem Formulation [ [6.21 1 (2.7) is constructed via Fact 
A. 2), an explanation is provided here regarding how to generate a 
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feasible solution z n of \ \6. 11 1 (2.6) which is close to vf in a 
sense to be specified. We first assume that no variables in 
[ 16. 1] 1 (2.6) are preassigned to zero (this assumption will be 
removed shortly) . The difficulty with the solution w° is that it 
need not satisfy the last n-m sets of constraints in 
I" T 6 . 11 1 (2 . 6) . Note, however, that if is an optimal solution 
for r T6.41 1 (2.9) and w" (constructed as in Fact A. 2) satisfies 
the relaxed constraints, then w° is optimal for I" T6 . Ill (2.6) . 
The recovery procedure described here is designed to preserve the 
0-1 character of the solution of r T6. 41 1 (2.9) as far as 
possible. That is, if ^...^=1 and i^O for at least one 
1=1,..., m, then the corresponding feasible solution z n of 
I" M (2 . 6 r . 11 1 ) is constructed so that z" lw _ in =l for some 
(i m+1 , . . . ,i n ) . Note that by this reasoning, variables of the form 
z o...oi m+1 ...i n can be assigned to a value of 1 in the recovery 
problem only if w$___ 0 =l. However, variables z n 0 ... oim+1 ... ln will be 
treated differently in the recovery procedure in that they can be 
assigned 0 or 1 independent of the value Wq...o- This increases 
the feasible set of the recovery problem, leading to a 
potentially better solution. 

Amend the paragraph beginning at column 35, line 18, as follows: 

Let {(rj,...,^)} be an enumeration of indices of w m (or the 

first m indices of w n constructed as in Fact A. 2) such that 
m 

w.j .j =1 and (ij, . . . , i^) * (0, . . . , 0) . Set ( ±° lr . . . , i°) = ( 0 , . . . , 0 ) 

for j=0 and define 




t [6.7] l (2.12) 
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for i k =0, . . . ,N k ; 

k=m+l, . . . ,n; j = 0, . . . ,N 0 . ] 



for i , =0 N , r ; 

k=m+l, . . . , n; 7=0, 



Let Y denote the solution of the (n-m+1 ) -dimensional assignment 
problem: 



[ [6.8] 1 (2.13) 



fv N ^ f-v n-m + l 



Subject to 3=1 r 



EE-E E -Ey jim+ ,..i=i> 

for i k =l,...,N k and k=m+l , . . . , n-1 , 

E E -E y JLl .. J =i. i„=i,...,N B , 



{0,1} 



for all j, 



The recovered feasible solution z n of f T6. 11 1 (2.6) corresponding 
to the multiplier set { u m , . . . , u n ] is then defined by [ [6.9]] 

II, z/(/ 1 ,...,/J=(^,...,/i)/or some 
j=0,...^ 0 and Y Jim ...i n =l, 014) 
0, otherwise. 

This recovery procedure is valid as long as all cost 

coefficients c n are defined and all zero-one variables in z n are 

free to be assigned. Note that modifications are necessary for 

sparse problems. If the cost coefficient 

[c.j . j . . ]c" .j. . is well defined and the zero-one variable 
1'*' m m+1"" n ''" lm ' m * 1 "- 1 " , 



[z-j -j . . ]c" _j_ is free to be assigned to zero or one, then 
n mm+1" n Ji^l^iu 

r n-m+l n . . n „_ m+1 „ 
define [c- { = c { ) f j . . ]<y W .. ln = c , as in r T6.71 1 (2.12) 

m+1 n l"*mm+r"n — — — - r " 

with zji m ™*l n being free to be assigned. Otherwise, z? m *) is 

preassigned to zero. To ensure that a feasible solution exists, 
we now only need ensure that the variables Zp™ +1 are free for 
j=0, 1, . . . , N 0 . (Recall that all variables of the form z n 0 ... ik ... 0 are 
free (to be assigned) and all coefficients of the form c n 0 __ lk __ 0 
are well defined for k=l,...,n.) This is accomplished as 
fallows. If the cost coefficient fl 

[c iJij...i j 0...0 ]c ^..4o-.o is wel1 defined and H&.J 0...0 ]z ^.,'o...o is 

12 m ■ " ' — „ 12m — - 

r ji-m+l 

being free. Otherwise, since all variables of the form z n 0 _ 



free, then define [c^ Q = c.j.j .j Q Jc? 0 J =0^ ^ with z™ 



..i k ...O 



are known feasible and have well-defined costs, put 

c o...o//o...o ' 



r n-m+l ^ n „- m+ i_ f> 

Lc jO...O " ^ c 0...0i 1 J 0...0 JC " ? - ° " ^ 



Amend the paragraph beginning at column 36, line 18, as follows: 

Starting with the M-dimensional assignment problem 
["r6.ni (2.6) , i.e., n=M, the algorithm described below is 
recursive in that the M-dimensional assignment problem is relaxed 
to an m-dimensional problem by incorporating {n-m) sets of 
constrains into the objective function using Lagrangian 
relaxation of this set. This problem is maximized with respect 
to the Lagrange multipliers, and a good suboptimal solution to 
the original problem is recovered using an (n-m+l ) -dimensional 
assignment problem. Each of these two (the m-dimensional and the 
(n-m+l ) -dimensional assignment problems) can be solved in a 
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similar manner. 



Amend the paragraph beginning at column 36, line 29, as follows: 

More precisely, reference is made to Figure 8 which presents 
a flowchart of a procedure embodying the multi-dimensional 
relaxation algorithm, referred to immediately above. This 
procedure, denoted MULTI_DIM_RELAX in Figure 8, has three formal 
parameters, n, PROB_FORMULATION and ASSIGNMT_SOLUTION, which are 
used to transfer information between recursive instantiations of 
the procedure. In particular, the parameter, n, is an input 
parameter supplying the dimension for the multi-dimensional 
assignment problem (as in [ \6. 11 1 (2.6) ) which is to be solved 
(i.e., to obtain an optimal or near-optimal solution). The 
parameter, PROB_FORMULATION, is also an input parameter supplying 
the data structure (s) used to represent the 12-dimensional 
assignment problem to be solved. Note that PROB_ FORMULATION at 
least provides access to the cost matrix, [c n ] , and the 
observation sets whose observations are to be assigned. 
Additionally, the parameter, ASSIGNMT_SOLUTION, is used as an 
output parameter for returning a solution of a lower dimensioned 
assignment problem to an instantiation of MULTI_DIM_RELAX which 
is processing a higher dimensioned assignment problem. 

Amend the paragraph beginning at column 36, line 51, as follows: 

A description of Figure 8 follows. Assuming MULTI_DIM_RELAX 
is initially invoked with M as the value for the parameter n and 
the PROB_FORMUIATION having a data structure (s) representing an 
M-dimensional assignment problem as in f f 5 . 511 (2.5) , in step 500 
an integer m, [2<m<n1 2 <m<n is chosen such that the constraint 
sets fori corresponding to dimensions m+l,...,n are to be relaxed 
so that an m-dimensional problem formulation as in FF6.211 (2.7) 
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results. In step 504 an initial approximation is provided for 
{ u™ +1 , . . . , u n 0 } . Subsequently, in step 508 the above initial values 
for { Uq +1 , . . . , u n 0 ) are used in an iterative process in determining 
(JF lm+1 , . . . r uJ Jn ) which maximizes {<P mn {u m+1 , . . . , u n ) where 
ru k eR Mk+1 l u k eR M * +1 and k=m+l, . . . , n} for a feasible solution w" 
subject to the constraints of Problem Formulation \ [6. 21 1 (2.7) . 
Note that by maximizing & mn ( u m+1 , . . . , u n ) , some of the constraints 
that were relaxed are being forced to be satisfied and in so 
doing information is built into a solution of this function for 
solving the input assignment problem in " PROB_FORMULATION . " 
Further note that a non-smooth optimization technique is used 
here and that a preferred method of determining a maximum in step 
508 is the bundle-trust method of Schramm and Zowe [as described 
in ]JH. Schramm and J. Zowe[, 1 . A version of the bundle idea for 
minimizing a non-smooth function: Conceptual idea, convergence 
analysis, numerical results [, 1 . SI AM Journal on Optimization, 2 
[(1992)], [pp]No. 1:121-152 , February, 1992) . This method, along 
with various other methods for determining the maximum in step 
508, are discussed below. 

Amend the paragraph beginning at column 37, line 10, as follows: 

Also note that for fm>21 m > 2 , a solution to the 
optimization problem of step 508 is NP-hard and therefore cannot 
be solved optimally. That is, there is no known computationally 
tractable method for guaranteeing an optimal solution. Thus, 
there are two possibilities: either (a) allow m to be greater 
than 2 and use auxiliary functions similar to those disclosed in 
the first embodiment of the ^-dimensional assignment solver 300 
in section I to compute a near-optimal solution, or (b) make m=2 
wherein algorithms such as the forward/reverse auction algorithm 
of D.P. Bertsekas and D.A. Castahon [in their paper, 1 (P.P. 
Bertsekas and D.A. Castanon. A forward/reverse auction algorithm 
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for asymmetric assignment problems [, ]_. Computational 

Optimization and Applications, 1[ (1992), pp.]j_ 277-298, 1992) 
provides an optimal solution. 

Amend the paragraph beginning at column 37, line 25, as follows: 

If option (a) immediately above is chosen, then the 
auxiliary functions are used as approximation functions for 
obtaining at least a near-optimal solution to the optimization 
problem of step 508. Note that the auxiliary functions used 
depend on the value of m. Thus, auxiliary functions used when 
m=3 will likely be different from those for m=A . But in any 
case, the optimization procedure is guided by using the merit 
function, & 2n { u 3 , . . . , u n ) , which can be computed exactly via a [2- 
dimensionall two-dimensional assignment problem for guiding the 
maximization process. 

Amend the paragraph beginning at column 37, line 34, as follows: 

Alternatively, if option (b) above is chosen, then two 
important advantages result \ : 1 , namely, the optimization problem 
of step 508 can be always solved optimally and without using 
auxiliary approximation functions. Thus, better solutions to the 
original M-dimensional assignment problem are likely since there 
is no guarantee that when the non-smooth optimization techniques 
are applied to the auxiliary functions the techniques will yield 
an optimal solution to step 508. Furthermore, it is important to 
note that without auxiliary functions, the processing in step 508 
is both conceptually easier to follow and more efficient. 

Amend the paragraph beginning at column 37, line 45, as follows: 

Subsequently, in step 512 of Fig. 8, the solution 
(uj }m+1 , . . . ,u n ) [and w n ] is used in determining an optimal 
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solution [, ] vf to Problem Formulation [[6.411 (2.9) as generated 
according to [ [6.31 1 (2.8) and Fact A. 3. 



Amend the paragraph beginning at column 37, line 49, as follows: 

In step 516, the solution w" is used in defining the cost 
matrix c n - ra+1 as in r T6. 71 1 (2 . 12) . Subsequently, if n-m+l=2, then 
the assignment problem r T6. 81 1 (2. 13) may be solved 
straightforwardly using known techniques such as forward/reverse 
auction algorithms. Following this, in step 528, the solution to 
the [2-dimensionall two-dimensional assignment problem is assigned 
to the variable ASSIGNMT_SOLUTION and in step 532 
ASSIGNMT_SOLUTION is returned to a dimension three level 
recursion of MULTI_DIM_RELAX for solving a [3-dimensionall three- 
dimensional assignment problem. 

Amend the paragraph beginning at column 37, line 59, as follows: 

Alternatively, if in step 520, n-m+l>2 , then in step 536 the 
data structure (s) representing a problem formulation as in 
[[6.811 (2.13) is generated and assigned to the parameter, 
PROB_FORMULATION. Subsequently, in step 54 0 a recursive copy of 
MULTI_DIM_RELAX is invoked to solve the lower dimensional 
assignment problem represented by PROB_FORMULATION . Upon the 
completion of step 540, the parameter, ASSIGNMT_SOLUTION, 
contains the solution to the [n-m+1 dimensionall (n-m+1) - 
dimensional assignment problem. Thus, in step 544, the [n- 
m+11 (n-m+1) th solution is used to solve the n-dimensional 
assignment problem as discussed regarding equations 
[[6.911 (2.14) . Finally, in steps 548 and 552 the solution to the 
n-dimensional assignment problem is returned to the calling 
program so that, for example, it may be used in taking one or 
more actions such as (a) sending a warning to aircraft or sea 



72 



facility; (b) controlling air traffic; (c) controlling anti- 
aircraft or anti-missile equipment; (d) taking evasive action; or 
(e) surveilling an object. 

Amend the paragraph beginning at column 38, line 12, as follows: 

There are many procedures described by Figure 8. One such 
procedure is the first embodiment of the ]multi dimensional] 
multi-dimensional assignment solving process of section 1.1. 
That is, by specifying m=n-l in step 500, a single set of 
constraints is relaxed in step 508. Thus, one set of constraints 
is incorporated [ is] into the objective function via the 
Lagrangian problem formulation, resulting in an [m=n-l 
dimensional] {m=n-l ) -dimensional problem. The relaxed problem is 
subsequently maximized in step 512 with respect to the 
corresponding Lagrange multipliers and then a feasible solution 
is reconstructed for the n-dimensional problem using a two- 
dimensional assignment problem. The second procedure provided by 
Figure 8 is a novel approach which is not suggested by the first 
embodiment of section 1.1. In fact, the second procedure is 
somewhat of a mirror image of the first embodiment in that n-2 
sets of constraints are simultaneously relaxed, yielding 
immediately an [m=2 dimensional] (m=2 ) -dimensional problem in step 
512. Thus, a feasible solution to the .n-dimensional problem is 
then recovered using a recursively obtained solution to an [n-1 
dimensional] (n-1 ) -dimensional problem via step 540. In this 
case, the function values and subgradients of <P 2n ( u 3 , . . . , u n ) of 
step 508 can be computed optimally via a [two dimensional] two- 
dimensional assignment problem. The significant advantage here 
is that there is no need for the merit or auxiliary functions, 
W k , as required in the first embodiment of the 

[multidimensional] multi-dimensional assignment solving process 
of section 1.1 above and also there is no need for the more 
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general merit or auxiliary functions W mnr as discussed in 
subsection II. 4. 2 below. Further, note that all function values 
and subgradients used in the [non-smooth] nonsmooth maximization 
process are computed exactly (i.e., optimally) in this second 
procedure. Moreover, problem decomposition is now carried out 
for the n-dimensional problem; however, decomposition of the [n-1 
dimensionall (n-1 ) -dimensional recovery problem (and all lower 
recovery problems) is performed only after the problem is 
formulated. Between these two procedures are a host of different 
relaxation schemes based on relaxing n - m sets of constraints to 
an ^-dimensional problem ( [2<m<nl 2<m<n ) , but these all have the 
same difficulties as the procedure for the first embodiment of 
section 1.1 in that the relaxed problem is an NP-hard problem. 
To resolve this difficulty, we use an auxiliary or merit function 
W mn as described in subsection II. 4. 2 below. (The notation W k was 
used for ¥ n _ lr „ in section 1.1.) For the case m<n-l, the recovery 
procedure is still based on an NP-hard ( [n-m+l-dimensional 1 n- 
m+1) -dimensional assignment problem. Note that the partitioning 
techniques similar to those discussed in Section 1.3 may be used 
to identify the assignment problem with a layered graph and then 
to find the disjoint components of this graph. In general, all 
relaxed problems can be decomposed prior to any [non-smooth] 
nonsmooth computations because their structure stays fixed 
throughout the algorithm of Fig. 8. However, all recovery 
problems cannot be decomposed until they are formulated, as their 
structure changes as the solutions to the relaxed problems 
change . 

Amend the paragraph beginning at column 39, line 4, as follows: 

One of the key steps in the Lagrangian relaxation algorithm 
in section II. 3 is the solution of the problem 

[ [7.1] 1 (2.15) 
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[Maximize (u m+1 , . . . , u n ) : u k eK M >< +1 ; k=m+l , . . . , n } ] 
Maximize i 0 „ „ ( u m+1 , . . . , u n ) : u k eW k+1 ; k= m+1 , . . . , n } , 
where u k =0 for all k=m+l, . . . , n . The evaluation of ^ (u m+1 , . . . , u n ) 
requires the optimal solution of the corresponding minimization 
problem [[6.2] Z n varies for each instance of (u m+1 , . . . ,u n ) 1 (2.7) . 
The following discussion provides some properties of these 
functions . 

Amend the paragraph beginning at column 39, line 12, as follows: 

Fact A. 4. Let u m+1 , . . . ,u n be multiplier vectors associated 
with the {m+l) st through the n th set of constraints [ [6. 11 1 (2.6) , 
let 0 mn be as defined in r [6. 11 1 (2.6) , let V n {¥ ]n ) be the 
objective function value of the n-dimensional assignment problem 
in equation [[6.111 (2.6) , let z" be any feasible solution of 
[[6.111 (2.6) , and let zj ]n be an optimal solution of 
r [6. 11 1 (2.6) . Then, [<D mn (u m+1 , . . . ,u n ) ] 0 mn ( u m+1 , . . . , u n ) ispiecewise 
affine, concave and continuous in { u m+1 , . . . , u n } and 

0 mn {u m+1 , . . . ,u n ) < V n (][ n ) < V n (z n }_^ r [7.2al 1 (2.16 ) 

Furthermore, 

$ m _ ln (u m ,u m+1 , . . . ,u n ) < O mn (u m+1 , . . . ,u n ) r [7.2al 1 (2.17 ) 

for all u k eR M x +1 with u£=0 and k=m, ...,n. 

Amend the paragraph beginning at column 39, line 23, as follows: 

Most of the procedures for non-smooth optimization are based 
on generalized gradients called subgradients, given by the 
following definition. 

Definition . At u= ( u m+1 , . . . , u n ) the set [ 50 mn (u) 1 d0 m „(u) is called 
a subdifferential of 0 mn and defined by 

[5d> mn (u)={q6M M ^i +1 x. . .xM M n +1 |O mn (w)-«> ffin (u) <q T (w-u)VweR M ^i +1 x. . .xM M « +1 } 
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[7.3] ] 

d€>„ Au)={cr € R^i^x. . .*W" +1 \<P m r {w) -$ „ Au) zcF { [w-u) VweiP^x . . .xRgTiB) 
[A vector qeb^y 1 A vector qeS^ (u) is called a subaradient. 

Amend the paragraph beginning at column 39, line 32, as follows: 

If z n is an optimal solution of r [6.21 1 (2.7) computed during 
evaluation of [<$> mn y ® mn i n n ] <P m n (u) , differentiating <P m r with 
respect to u "^ yields the following [in-th]!^ component of a 
subgradient g of [<J> mn Y] <P m n ( u) 



If z" is the unique optimal solution of [ [6.21 1 (2.7) , [5<t mn Y ® mn ] 
d@„„ ( u) =\ g} and & mn is dif f erentiable at u. If the optimal 
solution is not unique, then there are finitely many such 
solutions, say z n ( 1 ),..., z n {K) . Given the corresponding 
subgradients, g 1 r ... r g K , the subdif f erential [SOvl d&( u) is the 
convex hull of { g 1 , . . . r g K ) . 

Amend the paragraph beginning at column 39, line 51, as follows: 

For real-time needs, one must address the fact that the non- 
smooth optimization problem of step 508 (Fig. 8) requires the 
solution of an NP-hard problem for m>2 . One approach to this 
problem is to use the following merit or auxiliary function to 
decide whether a function value has increased or decreased 
sufficiently in the line search or trust region methods: 




[ [7.411 (2.19) 



for i k =l, . . . , N k and k=m+l, . . . , n. 
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f T7.511 (2.20) 



pn> m+1 v..,u n ) ifm = 2 

j _ or [(6.2)](2.7) is solved optimally, 

l*2nfo 3 '---»u m ;u m+1 ,...,u n ) otherwise - 

where the multipliers jp, . . . , u m that appear in lower order 
relaxations used to construct ( suboptimal ) solutions of the 
in-dimensional relaxed problem r (6.2) 1 (2.7) have been explicitly 
included. Note that [W mn y] ¥ m n is well-defined since (2.7) can 
always be solved optimally if m=2 . For sufficiently small 
problems r (6.2) 1 (2.7) or r (6.4) 1 (2.9) , one can more efficiently 
solve the NP-hard problem by branch and bound. This is the 
reason for the inclusion of the first case; otherwise, the 
relaxed function [<5 2n ] <P 7n is used to guide the nonsmooth 
optimization phase. That the merit function provides a lower 
bound for the optimal solution follows directly from Fact A. 4 and 
the following fact. 

Amend the paragraph beginning at column 40, line 9, as follows: 

Fact A. 5. Given the definition of [¥ mn y] 
¥ mn in (2.20) above, 
^ mn (u 3 , . . . , u m ; U m+1 , • • • , u n ) <$ mn (u m+1 , . . . , u n ) for all multipliers 
u 3 , . . . , u m , u m+1 , . . . ,u n . r T7.61 1 (2.21) 

The actual function value used in the optimization phase is 
[ PmnY] however, the subqradients are computed as in (2.19), 

but with the solution z1 1 ... ln being a suboptimal solution 
constructed from a relaxation procedure applied to the m- 
dimensional problem. Again, the use of these lower order relaxed 
problems is the reason for the inclusion of the multipliers 
j?, . . . , u m . 
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Delete the paragraph beginning at column 40, line 18, and replace it with the following new 
paragraph: 

To explain how the merit function is used, suppose there is 
a current multiplier set ( iffi j ,, . . . , and it is desirable to 

update to a new multiplier set ( u *i l, . . . , u " a , „) via ( u g „ . . . , u " c „) = 

Jj&d,- ■ • r u n old ) + {Au m+1 f . . . ,Au n ) . Then W „AxP ^ u *„; u m M u ?,J 

is computed where ( iH ; * , . . . , u m cl A is obtained during the relaxation 
process used to compute a high quality solution to the relaxed m- 
dimensional assignment problem (2. 7) at ( u m+1 , . . . , u n ) = 

The decision to accept ( u %t j, . . . , u " o w ) is then 

based on ¥„„ (ul ^ u ^,; u% i u l^) < W^iu 3 ^ tf? cr ,; 

uTJ ,, . . . ,u "„,. 7 ) or some other stopping criteria commonly used in 
line searches. Again, ( \? n „ „, . . . , u^ , „) represents the multiplier 
set used in the lower level relaxation procedure to construct a 
high quality feasible solution to the m -dimensional relaxed 

problem (2.7) at (u m+1 ,u n ) = (u Tl , J . The point is that 

each time one changes ( u m+1 , . . . , u n ) and uses the merit function 
¥ m „ ( IP , . . . , u m ; u m+1 , . . . ,u n ) for comparison purposes, one must 
generally change the lower level multipliers ( u 3 , . . . , if 1 ) . 

Amend the paragraph beginning at column 40, line 36, as follows: 

An illustration of this merit function for [m=n-11 m=n-l is 
given in ["PARTITIONING MULTIPLE DATA SETS, MULTIDIMENSIONAL 
ASSIGNMENTS AND LAGRANGIAN RELAXATION", by Aubrey B. Poore and 
Nenad Rijavec, and in "QUADRATIC ASSIGNMENT AND RELATED PROBLEMS, 
DIMACS SERIES IN DISCRETE MATHEMATICS AND THEORETICAL COMPUTER 
SCIENCE", in American Mathematical Society, Providence, R.I., 
Vol. 16, 1994, pp. 25-37 edited by Panos M. Pardalos and Henry 
Wolkowicz] (A.B. Poore and N. Rijavec. Partitioning Multiple Data 
Sets, Multidimensional Assignments and Lagrangian Relaxation. In 
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P.M. Pardalos and H. Wolkowicz, editors. Quadratic Assignment and 
Related Problems: DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, volume 16, pages 25-37, 1994) . 

Amend the paragraph beginning at column 40, line 47, as follows: 

By Fact A. 4 the function [0 mn y] @ m „ (u) is a continuous, 
piecewise affine, and concave, so that the negative of [0 mn yA] 
<P mr , {u) is convex. Thus the problem of maximizing [0 mn yA] 0 mn (u) is 
one of nonsmooth optimization. Since there is a large literature 
on such problems, only a brief discussion of the primary classes 
of methods for solving such problems is provided. A first class 
of methods, known as subgradient methods, are reviewed and 
analyzed in [the book by ]JN.Z. Shor[,]^. Minimization Methods for 
Non-Differentiable Functions [ , ] ^ Springer-Verlag, New York, 
19851. Despite their relative simplicity, subgradient methods 
have some drawbacks that make them inappropriate for the tracking 
problem. They do not guarantee a descent direction at each 
iteration, they lack a clear stopping criterion, and exhibit poor 
convergence (less than linear) . 

Amend the paragraph beginning at column 40, line 60, as follows: 

A more recent and sophisticated class of methods are the 
bundle methods; excellent developments are presented in [the 
books of Hiriart-Urruty and Lemarechal: ]_£J.-B. Hiriart-Urruty 
and C. Lemarechal [, Convex Analysis and Minimization Algorithms 
I and Springer-Verlag, Berlin, 1993; [and the book of 

]K.C. Kiwielf: ]_. Methods of Descent for Non-Differentiable 

Optimization . In A. Dold and B. Eckmann , editors. Lecture Notes 
in Mathematics, [Vol.] volume 1133, Berlin, 1985. Springer- 
Verlagf, Berlin, 1985J1. Bundle methods retain a set (or bundle) 
of previously computed subgradients to determine the best 
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possible descent direction at the current iteration. Because of 
the [non-smoothness] nonsmoothness of <P m q , the resulting 
direction may not provide a "sufficient" decrease in @ m n . In 
this case, bundle algorithms take a "null" step, wherein the 
bundle is enriched by a subgradient close to u k . As a result, 
bundle methods are non-ascent methods which satisfy the relaxed 

descent condition [O mn (u k+1 ) «S mn (u k ) if u k+1 *u k ] 0 mn (u kJ . 1 ) <@ mn (u k ) if 

Uk+itMk- These methods have been shown to have good convergence 
properties. In particular, bundle method variants have been 
proven to converge in a finite number of steps for piecewise 
affine convex functionals in JK.C. Kiwiel[, An [Aggregate 

Subgradient Method for Non-smooth Convex Minimization] aggregate 
subgradient method for non-smooth convex minimization [ , ] _j_ 
Mathematical Programming^ 27 [ , (1983) pp. ]j_320-341, rand] 1983; 
H. Schramm and J. Zowe[,]^_ A version of the bundle idea for 
minimizing a non-smooth function: Conceptual idea, convergence 
analysis, numerical results [,] SIAM Journal on Optimization, 2[ 
(1992)], [pp]No. 1:121-152 , February, 1992) . 



Amend the paragraph beginning at column 41, line 19, as follows: 

All of the above non-smooth optimization methods require the 
computation [ <P mn yA € 5 0 mn yA ] of <P mn (u) and a g E d& m n {u) . These in 
turn require the computation of the relaxed cost coefficients 
[ [6.3] 1 (2.8) . In both the first and second procedures discussed 
in section II. 3.1, maximization of [<P 2n l\\ @ 0n (u) must be 
repeatedly evaluated. In the most efficient implementations 
presently known of these two procedures, it was found that at 
least 95% of the computational effort of the entire procedure is 
spent in the evaluation of the relaxed cost coefficients 
[[6.311 (2.8) as part of computing [& 2n yA] @ 7n (u) . Thus, generally 
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a method should be chosen that makes as efficient use of the 
subgradients and function values as [is ] possible, even at the 
cost sophisticated manipulation of the subgradients. In 
evaluating three different bundle procedures: (a) the conjugate 
subgradient method of Wolfe used in section 1.1 of the first 
embodiment of the present invention; (b) the aggregate 
subgradient method of Kiwiel ([described in ]K.C. Kiwiel[, ]^_ 
An [Aggregate Subgradient Method for Non-smooth Convex 
Minimization] aggregate subgradient method for non-smooth convex 
minimization r . 1 . Mathematical Programming^ 27 [, (1983) pp. 
1 : 320-341 , 1983 ) ; and (c) the bundle trust method of Schramm and 
Zowe ([described in ]H. Schramm and J. Zowe[, 1 . A version of the 
bundle idea for minimizing a non-smooth function: Conceptual 
idea, convergence analysis, numerical results [, 1 . SI AM Journal 
on Optimization, 2[ (1992)], [pp]No- 1:121-152 , February, 1992 ). 
it was determined that for a fixed number of non-smooth 
iterations, say, ten, the bundle-trust method provides good 
guality solutions with the fewest number of function and 
subgradient evaluations of all the methods, and is therefore the 
preferred method. 

Amend the paragraph beginning at column 41, line 47, as follows: 

The forward/reverse auction algorithm of Bertsekas and 
Castanon ([as described in ]D.P. Bertsekas and D.A. Castanon[, 
A f orward/reverse auction algorithm for asymmetric assignment 
problems [, 1 . Computational Optimization and Applications, 1 
[(1992), pp. 1:277-298 , 1992 ) is used to solve the many relaxed 
[two dimensional] two-dimensional problems that occur in the 
course of execution. 
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Amend the paragraph beginning at column 41, line 55, as follows: 



The effective use of "hot starts" is fundamental for real- 
time applications. A good initial set of multipliers can 
significantly reduce the number of non-smooth iterations (and 
hence the number of [0 2n YA] evaluations) required for a high 
quality recovered solution. Further, there are several ways that 
multipliers can be reused. First, if [a] an n -dimensional 
problem is relaxed to [a] an in-dimensional problem, relaxation 
provides the multiplier set {u m+1 , u m+2 , . . . , u n } . These can be used 
as the initial multipliers for the [n-m+1 dimensional! (n-m+D- 
dimensional recovery problem for n-m+l>2 . This approach has also 
worked well to reduce the number of non-smooth iterations during 
recovery. 

Amend the paragraph beginning at column 41, line 66, as follows: 

Further, for track maintenance, initial feasible solutions 
are generated as follows. When a new scan of information (a new 
observation set) arrives from a sensor, one can obtain an initial 
primal feasible solution by matching new reports to existing 
tracks via a [two dimensional] two-dimensional assignment 
problem. This is known as the track-while-scan (TWS) approach. 
Thus, an initial primal solution exists and then we use the above 
relaxation procedure [is ] to make improvements to this TWS 
solution. Also for track maintenance, multipliers are available 
from a previously solved and closely related [multi-dimensional] 
multidimensional assignment problems for all but the new 
observation set. 
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Amend the paragraph beginning at column 42, line 12, as follows: 



Given a feasible solution of the [multi -dimensional] 
multidimensional assignment problem, one can consider local 
search procedures to improve this result, as described in JC.H. 
Papadimitriou and K. Steiglit z [ , ] ^ Combinatorial Optimization: 
Algorithms and Complexity[ , ] ^ Prentice-Hall , Inc. , Englewood 
Cliffs, NJ, 1982[, and]j_ J. Pearl [,] ^ Heuristics : [intelligent 
search strategies for computer problem solving,] Intelligent 
Search Strategies for Computer Problem Solving. Addison-Wesley, 
Reading, MA, 1984) . One method is the idea of [k-interchanges] Jr 
interchanges . Since for sparse problems only those active arcs 
that participate in the solution are stored, it is difficult to 
efficiently identify eligible variable exchange sets with some 
data structures for solving the assignment problem. However, a 
local search that may be more promising is to use the [two 
dimensional] two-dimensional assignment solver in the following 
way. Given a feasible solution to the [multi-dimensional] 
multidimensional assignment problem, the indices that correspond 
to active arcs in the solution are enumerated. Subsequently, one 
coordinate is freed to formulate a [two dimensional] two- 
dimensional assignment problem with one index corresponding to 
the enumeration and the other to the freed coordinate, and then 
solve a [two dimensional] two-dimensional assignment problem to 
improve the freed index position. 

Amend the paragraph beginning at column 42, line 34, as follows: 

The procedures described thus far are all based on 
relaxation. Due to the sparsity of assignment problems, however, 
frequently a decomposition of the problem into a collection of 
disjoint components can be done wherein each of the components 
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can be solved independently. Due to the setup costs of 
Lagrangian relaxation, a branch and bound procedure is generally 
more efficient for small components, say ten to twenty feasible 
0-1 variables (i.e., z i2 ... in ). Otherwise, the relaxation 
procedures described above are used. Perhaps the easiest way to 
view the decomposition method is to view the reports or 
measurements as a layered graph. A vertex is associated with 
each observation point, and an edge is allowed to connect two 
vertices only if the two observations belong to at least one 
feasible track of observations. Given this graph, the 
decomposition problem can then be posed as that of identifying 
the connected subcomponents of a graph which can be accomplished 
by constructing a spanning forest via a depth first search 
algorithm, as described in JA.V. Aho, J.E. Hopcroft, and J.D. 
Ullman[,]_s_ The Design and Analysis of Computer Algorithms [,] ^ 
Addison-Wesley [ Publishing Company, Reading], MA, 19741. 
Additionally, decomposition of a different type might be based on 
the identification of bi- and tri-connected components of a graph 
and enumerating on the connections. Here is a technical 
explanation. Let 

[Z = { z ill2 _ in | z ili2 _ in is not preassigned to zero}] 
M-=—Lz.i 1 i 2 . . .i n lz.i 1 i 2 . . \, ^ s not preassigned to zero} 
denote the set of assignable variables. Define an undirected 
graph G (N, A) where the set of nodes is 

[N={z;Jn=l, . . . ,n; i n =l, . . . ,N m }] 

i\7={z ? Jn=l n; i „ =l. . . . . N „] 

and arcs, 

[A={ (z!f n , z\ x ) |n*l] , j n *0, j^O and there exists z ili2 ... in ez 
such that j n =i n and ji=i x }] 
A={ (z'l^z 1 ^ ) r |n*11 \n±±, i n *0, 1^0 and there exists z tji „ f j ez . 

Amend the paragraph beginning at column 43, line 2, as follows: 
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Note that the nodes corresponding to zero index have not 
been included in the above defined graph, since two variables 
that have only the zero index in common can be assigned 
independently. Connected components of the graph are then easily 
found by constructing a spanning forest via a depth first search. 
(A detailed algorithm can be found in the book by Aho, Hopcroft 
and Ullman cited above) . Furthermore, this procedure is used at 
each level in the relaxation, i.e., is applied to each assignment 
problem \ f3.ll 1 (1.4) for n=3,...,M. 

Amend the paragraph beginning at column 43, line 12, as follows: 

The original relaxation problem is decomposed first. All 
relaxed assignment problems can be decomposed a priori and all 
recovery problems can be decomposed only after they are 
formulated. Hence, in the n-to-(n-l) case, we have n-2 relaxed 
problems that can all be decomposed initially, and the recovery 
problems that are not decomposed (since they are all [two 
dimensional] two-dimensional ) . In the n-to-2 case, we have only 
one relaxed problem that can be decomposed initially. This case 
yields n-3 recovery problems, which can be decomposed only after 
they are formulated. 

Insert the following heading before the paragraph beginning at column 43, line 22: 

III. New Approaches to Track Initiation and Maintenance 
Using Multidimensional Assignment Problems 

Amend the paragraph beginning at column 43, line 22, as follows: 

The ever-increasing demand for sensor surveillance systems 
is to accurately track and identify objects in real-time, even 
for dense target scenarios and in regions of high track 
contention. The use of multiple sensors, through more varied 
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information, has the potential to greatly improve target state 
estimation and identification. However, to take full advantage 
of the available data, a multiple frame data association approach 
is needed. The most popular such approach is an enumerative 
technique called multiple hypothesis tracking (MHT) . As an 
enumerative technique, MHT can be too computationally intensive 
for real-time needs because this problem is NP-hard. A promising 
approach is to utilize the recently developed Lagrangian 
relaxation algorithms (K. P. Pattipati, S. Deb, and Y . Bar-Shalom. A 
multisensor-multitarget data association algorithm for 
heterogeneous sensors. IEEE Transactions on Aerospace and 
Electronic Systems, 29, No. 2:560-568, April 1993; A.B. Poore and 
N.Riiavec. Partitioning multiple data sets: multidimensional 
assignments and lagrangian relaxation, in quadratic assignment 
and related problems, P.M. Pardalos and H.Wolkowicz, editors, 
DIMACS series in Discrete Mathematics and Theoretical Computer 
Science, 16:25-37, 1994; A.J. Robertson III. A class of 
lagrangian relaxation algorithms for the multidimensional 
problem. Ph.D. Thesis, Colorado State University, Ft. Collins, 
CO, 1 9 9 5 ) for the multidimensional assignment problem; however, 
there are many other potentially good approaches to these 
assignment problems such as LP relaxation combined with an 
interior point method, GRASP, and parallelization . 

Amend the paragraph beginning at column 43, line 57,as follows: 

III . 2 . Overview of the Tracking Problem 

Amend the paragraph beginning at column 43, line 58, as follows: 

Tracking and data fusion are complex subjects of 
specialization that can only be briefly summarized as they are 
related to the subject of this paper. The processing of track 
multiple targets using data from one or more sensors is typically 
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partitioned into two stages or major functional blocks, namely, 
signal processing and data fprocessl processing ( Y. Bar-Shalom. 
Multitaraet-Multisensor Tracking: Advanced Applications . Artech 
House, Dedham, MA, 1990; Y. Bar-Shalom and T.E. Fortmann. Tracking 
and Data Association. Academic Press, Boston, MA, 1988; S.S. 
Blackman. Multiple Target Tracking with Radar Applications . 
Artech House, Dedham, MA, 198 6) . The first stage is the signal 
processing that takes raw sensor data and outputs reports. 
Reports are sometimes called observations, threshold exceedances, 
plots, hits, or returns, depending on the type of sensor. The 
true source of each report is usually unknown and can be due to a 
target of interest, a false signal, or persistent background 
objects that can be moving in the field of view of the sensor. 

Amend the paragraph beginning at column 44, line 23, as follows: 

III . 2 . 1 Tracking Functions 

Amend the paragraph beginning at column 44, line 36, as follows: 

In track maintenance, the data association function decides 
how to relate the reports from the current frame of data to the 
previously computed tracks. In one approach, at most one report 
is assigned to each track, and in other approaches, weights are 
assigned to the pairings of reports to a track. After the data 
association, the filter function updates each target state 
estimate using the one or more (with weights) reports that were 
determined by the data association function. A filter commonly 
used for multiple target tracking and data fusion is the well 
known Kalman filter (or the extended Kalman filter in the case of 
nonlinear problems) or a simplified version of it (Y. Bar-Shalom. 
Multitaraet-Multisensor Tracking: Advanced Applications . Artech 
House, MA, 1990; Y. Bar-Shalom and T.E. Fortmann. Tracking and 
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Data Association. Academic Press, Boston, MA, 1988; S.S 



Blackman. Multiple Target Tracking with Radar Applications . 
Artech House, Dedham, MA, 1986) . 

Amend the paragraph beginning at column 44, line 62, as follows: 

There have been numerous approaches developed to perform the 
data association function. Since optimal data association is far 
too complex to implement, good but practical sub-optimal 
approaches are pursued. Data association approaches can be 
classified in a number of ways. One way to classify data associ- 
ation approaches is based on the number of data frames used in 
the association process r . 1 (O.E. Drummond. Multiple sensor 
tracking with multiple frame, probabilistic data association. In 
Signal and Data Processing of Small Targets, SPIE Proceedings , 
volume 2561, pages 322-336, 1995) . In single frame data 
association for track maintenance, "hard decisions" are made 
[each frame as to how the] on the assignment of reports [ are to be 
related] to the tracks. Some single frame approaches include: 
individual nearest neighbor, PDA, JPDA, and global nearest 
neighbor (sequential most probable hypothesis tracking) , which 
uses a [two dimensional] two-dimensional assignment algorith m (Y. 
Bar-Shalom. Multitarget-Multisensor Tracking: Advanced 
Applications. Artech House, MA, 1990; Y. Bar-Shalom and T.E. 
Fortmann. Tracking and Data Association. Academic Press, Boston, 
MA, 1988; S.S. Blackman. Multiple Target Tracking with Radar 
Applications . Artech House, Dedham, MA, 1986) . In most single 
frame data association approaches, only one track per object is 
carried forward to be used in processing the next frame of 
reports . 
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Amend the paragraph beginning at column 45, line 1 1, as follows: 



Multiple frame data association is more complex and 
frequently involves purposely ["carry! carrying forward more than 
one track per target to be used in processing the next frame of 
reports. By retaining more than one track per target, the 
tracking performance is improved at the cost of increased 
processing load. The best known multiple frame data association 
approach is an enumerative technique called multiple hypothesis 
tracking (MHT) which enumerates all the global hypothesis with 
various pruning rules. 

Amend the paragraph beginning at column 45, line 59, as follows: 

The integrated approach just discussed, uses the same number 
of frames of reports for both track initiation and track 
maintenance. The goal in using the multi-dimensional assignment 
algorithm is to provide improved performance while minimizing the 
amount of processing required. Typically, track initiation will 
benefit from more frames of reports than will track maintenance. 
ThuSj. a second approach that integrates track initiation and 
track maintenance is discussed hereinafter, wherein the number of 
frames of reports is not the same for these two functions. This 
is a novel approach that is introduced in this paper. 

Amend the paragraph beginning at column 46, line 4, as follows: 

There are many advantages and many ways [to] of combining 
data from multiple sensors. There are also many ways of 
categorizing the different algorithmic architectures for 
processing data from multiple sensors. One approach outlines 
four generic algorithmic architectures (O.E. Drummond. Multiple 
sensor tracking with multiple frame, probabilistic data 
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association. In Signal and Data Processing of Small Targets, SPIE 
Proceedings, volume 2561, pages 322-336, 1995) . Two of these 
generic architectures are especially pertinent to this paper and 
are summarized briefly. 

Amend the paragraph beginning at column 46, line 1 1, as follows: 

In the Centralized Fusion algorithmic architecture, reports 
are combined from the various sensors to form global tracks. 
This algorithmic architecture is also called Central Level 
Tracking, Centralized Algorithmic Architecture, or simply the 
Type IV algorithmic architecture. In track maintenance^ for 
example, if a single frame data association is used, then for 
data association a frame of reports from one sensor is processed 
with the latest global tracks; then the global tracks are updated 
by the filter function. After the processing of this frame of 
reports is completed, a frame of the reports from another (or the 
same) sensor is processed with these updated global tracks. This 
process is continued as new frames of data become available to 
the system as a whole. 

Amend the paragraph beginning at column 46, line 35, as follows: 

The second pertinent algorithmic architecture is Track 
Fusion. This approach is also called the Hierarchical or 
Federated algorithmic architecture, sensor level tracking or 
simply the Type II algorithmic architecture. In track 
maintenance^ for example, a processor for each sensor computes 
single sensor tracks; these tracks are then forwarded to the 
global tracker to compute global tracks based on data from all 
sensors . 
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Amend the paragraph beginning at column 46, line 47, as follows: 

After the first time a sensor processor forwards tracks to 
the global tracker, then subsequent tracks for the same targets 
are cross-correlated with the existing global tracks. This 
track-to-track cross-correlation is due to the common history of 
the current sensor tracks and the tracks from the same sensor 
that were forwarded earlier to the global tracker. The 
processing must take this cross-correlation into account and 
there are a number of ways of compensating for this-cross- 
correlations . One method for dealing with this cross-correlation 
is to decorrelate the sensor tracks that are sent to the global 
tracker. There are a variety of ways to achieve this 
decorrelation and some are summarized in [Drummond, 1996, Signal 
Data Proc] recent paper (Q.E. Drummond, Feedback in track fusion 
without process noise. In Signal and Data Processing of Small 
Targets [19951 , SPIE Proceedings , f -25 61 : 1 volume 2561. pages 369- 
383 , 1995 . 

Amend the paragraph beginning at column 47, line 2, as follows: 

III . 3 Formulation of the Data Association Problem 

Amend the paragraph beginning at column 47, line 4, as follows: 

The goal of this section is to briefly outline the 
probabilistic framework for the data association problems 
presented in this work. The technical details are presented 
elsewhere (A.B. Poore. Multidimensional assignment formulation 
of data association problems arising from multitarget tracking 
and multisensor data fusion. Computational Optimization and 
Applications,. 3:27-57, 1994) . The data association problems for 
multisensor and multitarget tracking considered in this work are 
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generally posed (A.B. Poore. Multidimensional assignment 
formulation of data association problems arising from multitaraet 
tracking and multisensor data fusion. Computational Optimization 
and Applications, 3:21-51, 1994) as that of maximizing the 
posterior probability of the surveillance region (given the data) 
according to 

Maximize [P(T=y I Z N+l )\y e T*} [(3.1)] 

where Z N+1 represents N+l data sets, y is a partition of indices 
of the data (and thus induces a partition of the data) , r* is 
the finite collection of all such partitions, r is a discrete 
random element defined on r*, [y° is a reference partition,] and 
P(r=y|z N+1 ) is the posterior probability of a partition y being 
true given the data Z N+1 . The term partition is defined below; 
however, this framework is currently sufficiently general to 
cover set packings and coverings. 

Amend the paragraph beginning at column 47, line 27, as follows: 

Consider N+l data sets Z ( k) ( k=l , . . . , N+l ) , each consisting of 

k 

M k actual reports and a dummy report Zq, and let denote the 
cumulative data set defined by 

Z(k) = and Z N+ 1 = {Z(l),... ,Z(N+ 1)}, (3.2) 

k 

respectively. (The dummy report z^ serves several purposes in 
the representation of missing data, false reports, initiating 
tracks, and terminating tracks (A.B. Poore. Multidimensional 
assignment formulation of data association problems arising from 
multitarget tracking and multisensor data fusion. Computational 
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Optimization and Applications , 3:27-57, 1994) .) In multisensor 
data fusion and multitarget tracking the data sets Z(k) may 
represent different classes of objects, and each data set can 
arise from different sensors. For track initiation the objects 
are reports that must be partitioned into tracks and false 
alarms. In our formulation of track maintenance, which uses a 
moving window, one data set will be tracks and remaining data 
sets will be reports which are assigned to existing tracks, as 
false reports, or to initiating tracks. 

Amend the paragraph beginning at column 47, line 44, as follows: 

We specialize the problem to the case of set partitioning 
(A.B. Poore. Multidimensional assignment formulation of data 
association problems arising from multitarget tracking and 
multisensor data fusion. Computational Optimization and 
Applications , 3:27-57, 1994) defined in the following way. 
Define a "track of data" as where each i k [and] can assume 
["the] zero or nonzero values [ of 0 and , respectively]. A 
partition of the data will refer to a collection of tracks of 
data wherein each report occurs exactly once in one of the tracks 
of data and such that all data is used up; the occurrence of 
dummy report is unrestricted. The reference partition y° is that 
in which all reports are declared to be false. 

Amend the paragraph beginning at column 47, line 53, as follows: 

Next, under appropriate independence assumptions one can 

show 

P(T = YlZ N+1 ) = - m % L 
P(T = y°|Z n+1 ) (Wi^Y ,1 " w 

Li i- i N+i a likelihood ratio containing probabilities for 
detection, maneuvers, and termination as well as probability 
density functions for report errors, track initiation and 
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termination. 
c. .... = -lnl. .. 



f 1 ifiz. .. . ) are assigned to as a track, 

Z. .... =1 1 N*l 

i N+i i o otherwise. 



[ (3.4)1 (1.7) 



Amend the paragraph beginning at column 48, line 6, as follows: 

Then recognizing 



that, _ to SFY]L^VjZ^) 

lP([ Y °]r = y'lz"* 1 ) 



(,„...^ +1 )e Y [ C] 



the problem (3.1) 



can be expressed as the rN+l-dimensional 1 (N+l) -dimensional 
assignment problem 



Minimize 22 ••• z2 c ,- ,• z , 



h =0 »jm =0 

M M^, Mj. M. 



Swoyetf To }2 - £ V™ = !> *'i = Iv-^i, (3.5) 



'l =0 »*-l =0 '*+l =0 *y + l =0 1 
/or / fc = l,...M k and k=2,...JI, 

'1=0 Wl = <> 

%+i 6(0,1} /or a// i v ...,i N+v 



where c 0 0 is arbitrarily defined to be zero. Here, each group of 
sums in the constraints represents the fact that each non-dummy 
report occurs exactly once in a "track of data." One can modify 
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this formulation to include [multiassignments ] multi-assignments 
of one, some, or all the actual reports. The assignment problem 
(3.5) is changed accordingly. For example, if is to be 
assigned no more than, exactly, or no less than »* times, then 
the "=1" in the constraint (3.5) is changed to "<, =, > nf , " 
respectively. In making these changes, one must pay careful 
attention to the independence assumptions, which need not be 
valid in many applications. Expressions for the likelihood ratios 
can be found in the work of [Poore, 1994, Computational 
Optimization & Appl., 3 : 27-57 , 1 (A. B . Poore. Multidimensional 
assignments and multitarget tracking, partitioning data sets, 
I.J. Cox, P. Hansen, and B. Julesz, editors. DIMACS Series in 
Discrete Mathematics and Theoretical Computer Science, American 
Mathematical Society, Providence, R.I., 19:169-198 , 1995) and the 
references therein. 

Amend the paragraph heading beginning at column 48, line 47, as follows: 

III. 4. Track Initiation and Maintenance 
Amend the paragraph heading beginning at column 48, line 58, as follows: 

III. 4.1 The First Approach to Track Maintenance and 
Initiation 

Amend the paragraph beginning at column 48, line 59, as follows: 

The first method as explained in this section is an improved 
version of our first track maintenance scheme (A.B. Poore. 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor data 
fusion. Computational Optimization and Applications , 3:27-57, 
1994 ) and uses the same window length for track initiation and 
maintenance after the initialization step. The process is to 
start with a window of length N+l anchored at frame one. In the 



95 



first step [one] there is onl y one track initiation in that we 
assume no prior existing tracks. In the second and all 
subsequent frames, there is a window of length N anchored at 
frame k plus a collection of tracks up to frame k. This window is 
denoted by {k[; ]j_k+l, . . . , k+N} . The following explanation of 
the steps is much like mathematical induction in that we explain 
the first step and then step k to step k+1 . 

Amend the paragraph beginning at column 49, line 4, as follows: 

Track Maintenance and Initiation: Step 1. Let 
{/ 1 (/ 2 ),/ 2 (/ 2 )...,/ iV (/ 2 ),/ Ar+1 (/ 2 )}^ 1 ([4.1] ] 3^6 ) 

be an enumeration of all those zero-one variables in the solution 
of the assignment problem (3.5) (i.e., z. . . _.) excluding all the 
false reports in the solution (i.e., all those zero-one variables 
with exactly one nonzero index) and zero-one variables in the 
solution for which i 2 ) = (0, 0) . (The latter can correspond to 
tracks that initiate on frames three and higher.) These denote 
our initial tracks. 

Amend the paragraph beginning at column 49, line 14, as follows: 

Consider only the first two index sets in this enumeration 
([4.111 3.6 ) and add the zero index 1 2 =0 with the corresponding 
values of i 1 and i 2 being zero. Thus, the enumeration is now 
{*i^2)'*2^2)}t=o • The notation r 2 (/ 2 ) = C^y^yy) will be used for this 
pairing. Suppose now that the next data set, i.e., the (N+2) th 
set, is added to the problem. 

Amend the paragraph beginning at column 49, line 20, as follows: 

To explain the costs for the new problem, one starts with 
the hypothesis that a partition yeT* being true is now 
conditioned on the truth of the pairings on the first two frames 
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being correct. Corresponding to the sequence {^(/^.z^,...^ J, the 

likelihood function is then given by 

T4.2a1 (3.7) 

L v = TC L, . . , where 

{T 2 (l^ i3 ,...^\ey 



Amend the paragraph beginning at column 49, line 34, as follows: 

Next, define the cost and the corresponding zero-one 
variable 



1, z/^,...^ + 2 2 J is assigned to Track T 2 (l 2 ), 



( 0, otherwise, 



( [4.2b]3^8) 



respectively. Then the track maintenance problem Maximize 
{ L v \y€F* } can be formulated as the following multidimensional 
assignment 



Minimize 



L=n i.=n i._ =n 23 N * 2 2 3 "* 2 
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Subject to: m, (3.9) 

i 3 =0 i N+2 =0 23 N 2 

2^2^ -1^ Z Lu...i N = 1 . *3 = 1 »- ^3' 

12=0 i 4 =0 i N+2 =0 3 3 * +2 

e t:t e...e\_ .. 

12=0 i 3 =0 ^,=0 i N+2 =0 23 " +2 

for i p =\,...M p and p=4,...JN+2-l, 

12=0 i 3 =0 Wi=0 N+2 

Amend the paragraph beginning at column 50, line 5, as follows: 

Track [Maintence] Maintenance and Initiation: Step k. At the 
beginning of the k th step, we solve the following (N+l) - 
dimensional assignment problem. 



[{4.4) 1 (3.10) 



Minimize!:] ^ ^-"^^V-'wf Subject 

1 k =0 ^+1 = ° i k + N =0 



£ 3r ...e £ ... e" * w -, 

"k=° ifc tl =0 ^,=0 ^,=0 i k+N =0 k * N 

for i =l,...M and p=k+2,...Jf+k-l, 
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l k =0 i k+1 =0 i k+ltN _ 2 =0 



where for the first step l x and L x are replaced by i x and M lr 
respectively. The first index l k in the subscripts corresponds to 



problem prior to the formulation of ([4.41 3.10 ) . r or if 1 If k=l_,_ 
then it is just the first data set in frame one. 

Amend the paragraph beginning at column 50, line 41, as follows: 

Basic Assumption. Suppose problem ( [4.41 3.10 ) has been 
solved and let the solution, i.e., those zero-one variables equal 
to one, be enumerated by 



with the following exceptions. 

a. All [zero one] zero-one variables for which Q k ,i k+l )-(0,0) 
are excluded. Thus, tracks that initiate on frames 
after the (k+l) th are not included in the list. 

b. All zero-one variables whose subscripts have the form 
l k =0 and exactly one nonzero index in the remaining 
indices {ik+v-'h+N^ are excluded. These correspond to 
false reports on frames [p=k+ll p = k+1 ,...,[ k+Nl k+N . 





( [4.51 3.11 ) 



c . 



All variables te^J] h^.., k J^ which /, +iV )<0,0,...,0) 
and i k (l k ) = 0 [in! are excluded from ( [4.51 1.11 ) . In other 
words, the reports on the last N+l frames in the 
\r^J^^,...^*^\ are all dummy. Any solution with this 
feature corresponds to a terminated track. 
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Amend the paragraph beginning at column 50, line 58, as follows: 



Given the enumeration ( [4 ] 3 . [ 5] 11 ) , one now fixes the 
assignments on the first two index sets in the list 
([4] 3. [5] 11) . The zero index l k+1 = 0 is added to the enumeration 
to specify [l k ( 0 ) , i k+1 (0 ) )= ( 0, 0 ) that is used to represent 
false reports and tracks that initiate on frame k+2 or later, 
so that the enumeration ( [4.51 3.11 ) is now 



Amend the paragraph beginning at column 51, line 9, as follows: 

The corresponding hypothesis about a partition y E F* 
being true is now conditioned on the truth of the L k+1 tracks 
existing at the beginning of the N-frame window. (Thus the 
assignments prior to this sliding window are fixed. ) The 
likelihood function is given by 



Amend the paragraph beginning on column 51, line 23, as follows: 

Next, define the cost and the zero-one variable by 
[said at least one inert gas has an amount, on a molar basis, 
that is greater than the amount of said oxygen in said 




[ (4.6) ] 




( [4.7al 3.12 ) 



pressurized medium; 



(4.7b) ] 





(3.13) 



1, if\z^,-»,z£ i *"j is assigned to T k+1 {l k+1 ) , 



0, otherwise, 
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respectively, so that the track extension problem, which was 
originally formulated as Maximize {L y \yer*\, can be expressed 
as exactly the same multi-dimensional assignment in (3.4) 
[but ]with k replaced by k+1 . Thus, we do not repeat it here. 

Amend the paragraph beginning at column 51, line 42, as follows: 

III. 4. 2. The Second Approach to Track Maintenance and 
Initiation 

Amend the paragraph beginning at column 51, line 50, as follows: 

The General Step k. To formulate a problem for track 
initiation and maintenance we consider a moving window 
centered as frame k of length I+J+l denoted by 
[k-I , k, ... , k+J] . In this representation, the window length 
for track maintenance is J and that for initiation, I+J+l. 
The objective will be to explain the situation at this center 
and then the move to the same length window at center k+1 

denoted by [ \ k+l-1 1 k+1 -I , ... , k+1 Tk+l+Jl k+l+J ] , i.e., by 

moving the \ frame! window to the right one frame at time [ to 
the right] . The explanation from the first step follows 
hereinafter . 

Amend the paragraph beginning at column 51, line 60, as follows: 

The notation for a track of data is 

T k < ^ ' "' Z W r - r ([4.8] 3^14 ) 

where the index l k is used for an enumeration of those 
reports paired together. We also use the notation T Plk ( 1 k ) to 
denote the sequence of reports belonging to track T k (l k ) but 
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restricted to frames prior to and including p. Thus, 



( f4 . 91 3. 15 ) 

Amend the paragraph beginning at column 52, line 7, as follows: 

Given this notation for the tracks and partition of the 
data in the frames {k- 1 , ... , k, ... , k+J) , L T p>k a k ) will denote the 
accumulated likelihood ratio up to and including frame p(p<k) 
for a track that is declared as existing on frame k as a 
solution of the assignment problem. In this notation, the 
likelihood for T Ptk (l k ) and that of the association of 

z i k + ^' "' ' z il™ | w ith track T k^k^ is given by 
L W = \ k (h)\^ k )-W f ° r an yP* k ~ 1 ' 

I y^wi M = \ t (vv'V"^(Vi t( ri M for anyp * k ~ lr 

( f4. 101 3. 16 ) 

respectively. 

Amend the paragraph beginning at column 52, line 20, as follows: 

The cost for the assignment of j z^ , - , z**" j to track 

T k (l k ) and the corresponding [zero onel zero-one variable 
are given by 
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-In [L T 



1, if jzfj^, z**" | is assigned to track T k (l k 
0, otherwise, 



( f4. 111 3. 17 ) 



respectively. Likewise, for costs associated with the false 

reports on the frames k-I to k and as associated with 

jz^,...,Zj^| and the corresponding zero-one 

I" variable] variables are given by: 

C £i-Wi™i* +J = " ln [ L i k - 1 -i k i k , 1 -i j J ([4.12] 3.18 ) 

' 1, if {z z z } 

Zi t-i- i t i w- i w ~ I are assigned as a track, 
[ 0, otherwise. 

For the window of frames in the range [ [k-I ,k~\ ] \k-I,...,k) , 
the easiest explanation of the partition of the reports is 
based on the definitions 



(i p \zf belongs to one of the tracks 
listed on frame k, i.e., to one 
of the T k ( l k ) for some l k = l, ...,l k 

-- {{1, . . .,M p }\T p k )u{0}, 



so that all of those reports not used in the tracks T k ^ k ) on 
frame p are put into the set of available reports F pik for 
the formation of tracks over the entire window. Thus, we 
formulate the assignment problem as 
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Minimize £ ^ £ 

p=k-I i p eF ptk r=k+l i r =0 

* t £ t < 1 ,. I ... 1 „// A . 1 ... li .. 



_ je . r .._ J ,_ J( . +1 ..._ fc . *i k r ..i t i wl ...jL T 

p=k-I i p €F pik r=k+l i r =0 * * 1 * J 



l k =l r=k+l i r =0 

Subject To £ X) £ £ < ij k i =1 (3.20) 

(p=M,p#gl i 6F pit r=irtl i r =0 * +J 

for i q EF pik \{0'} and q=k-I,...,k r 

i e £ £< r .. v _ lw =i 

p=A:-J i p 6F pjk {r=Jc+l,.zr#g} i g =0 * J 

for i q =l,...,M q and q= k+1, k+J, 

r=Jc+l i r =0 

£ £^,=1,1=1,...,^ 

l k =l (r=k+l,r*q} i r =0 k k 1 * +J y y 

for q=k+l, k+J, 



Amend the paragraph beginning at column 53, line 21, as follows: 

Basic Assumptions . Suppose problem ( T4.141 1.20 ) has been 
solved and let the solution, i.e.[,] those zero-one variables 
equal to one, be enumerated by 



( [4 . 151 3.21 ) 



^v r ii w )-i )[ (i w )i w (i t)1 )-i w (i w ) +i 

with the following exceptions. 

a. All [zero one] zero-one variables in the second list for 
which (ijt-jf -I i k r i k+1 ) = (0,-, 0, 0) are excluded. Thus, 
tracks that initiate on frames after the {k+l) th are not 
included in the list. 
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b. All false reports [axe] are excluded, i.e., all zero-one 
variables in the second list whose subscripts have 
exactly one nonzero index. 

c. All variables z i k i k+1 ...i k+N for which U k+1 , i k+N ) = ( 0, 0, 0) 
and Z(p) nT k {l k ) =0 for p =k-K,...,k where \K>Q] K >0 is user 
specified. Thus the track T k ^ k ) is terminated if it is 
not observed over K+J+l frames. 

Given the enumeration ( [4.151 3.20 ) , one now fixes the 
assignments on the all index sets up to and including the 
(k+1) th index sets. 

[ (4.16) ] 



for 1 M = 1, . . .,L„ , 



(3.22) 



Amend the paragraph beginning at column 53, line 52, as follows: 

Thus one can now formulate the assignment problem for 
the next problem exactly as in ( [4-141 3.20 ) but with k 
replaced by k+1. Thus, we do not repeat it here. 

Amend the paragraph beginning at column 54, line 7, as follows: 

If [ I+J>N] I+J > N , then one possibility is to start the 
process with N+l frames, and assuming J<N, proceed as before 
replacing I by N-J for the moment, and continue to add frames 
without lopping off the first frame in the window until 
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reaches a window of length I+J+l. Then we proceed as in the 
previous paragraph. 

Amend the paragraph beginning at column 54, line 14, as follows: 

If [ I+J<N] I+J < N . then one can solve the track 
initiation problem (3.5), formulate the problem with the 
center of the window at \ k+l=N+l-J] k+1 = N+l-J . enumerate the 
solutions as above, and lop off the first N-J-I frames. 
Then, we proceed just as in the case I+J=N. 

Insert the following heading before the paragraph beginning at column 54, line 37 : 

I I I. 5. CONCLUDING COMMENTS 

Amend the paragraph beginning at column 54, line 37 as follows: 

Suppose we have solved problem ( [4 . 41 3 . 10 ) and have 
enumerated all those zero-one variables in the solution of 
( r4 . 41 3. 10 ) as in ( [4.51 3.11 ) . Add the zero index l w =0, so 
that the enumeration is 




( r5.11 3.23 ) 



With this enumeration one can define the cost by 

and the [two dimensional] two-dimensional assignment problem 

[ (5.3) 1 (3.25) 
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0 2 = Minimize 22 zl c i 1 z l ± = VAz 2 ) 
Subject to X z 2 2 wW =l, l k+1 = l,...,L k+1 , 

Let w be an optimal or feasible solution to this two- 
dimensional assignment problem and define 

( f5. 41 3.26 ) 

1, if (± k+1 r...,i k+N ) = (i k+1 (l k+1 ),..., i k+N d k+1 )) 
and w 2 i =1 for some I jt+1 = l / L Jc+1 
or if 7Ci" = (0,0) 

0, otherwise. 

This need not satisfy the constraints in that there are 
usually many objects left unassigned. Thus, one can complete 
the assignment by using the zero-one variables in ( T4 . 41 3. 10 ) 
with k replaced by k+1 with exactly one nonzero index 
corresponding to any unassigned object or data report. 

Amend the paragraph beginning at column 55, line 16, as follows: 

For the dual solutions, the multipliers arising from the 
solution of the [two dimensional] two-dimensional assignment 
problem ( T5.31 3.25 ) corresponding to the second variable, 
i.e., | . These are good initial values [fori to 

use in a relaxation scheme f \ 11 , 12 1 1 (A. B . Poore and 
N.Riiavec. Partitioning multiple data sets: multidimensional 
assignments and Lagrangian relaxation, in quadratic 
assignment and related problems; P.M. Pardalos and H. 
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Wolkowicz, editors, DIMACS series in Discrete Mathematics and 
Theoretical Computer Science, 16:25-37, 1994; A.J. Robertson 
III. A class of lagrangian relaxation algorithms for the 
multidimensional assignment problem. Ph.D. Thesis, Colorado 
State University, Ft. Collins, CO, 1995) . Finally, note that 
one can also develop a warm start for problem ( [4 . 141 3 . 20 ) in 
a similar fashion. 

Insert the following heading before the paragraph beginning at column 55, line 22 : 

IV. REVIEW OF NEW RELAXATION SCHEMES 
IV. 1. Introduction 

Multidimensional assignment problems govern the central 
problem of data association in multisensor and multitarget 
tracking, i.e., the problem of partitioning observations from 
multiple scans of the surveillance region and from either 
single or multiple sensors into tracks and false alarms. 
This fundamental problem can be stated as (A.B. Poore. 
Multidimensional assignments and multitarget tracking, 
partitioning data sets, I.J. Cox, P. Hansen, and B. Julesz, 
editors, DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, American Mathematical Society, 
Providence, R.I., 19:169-198, 1995; A.B. Poore. 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor 
data fusion. Computational Optimization and Applications , 
3:27-57, 1994) 

Minimize £ c i i z i i r (1.1) 1 (4.1) 

i, = 0 i„=0 l w l n 
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Subject to: 



fc...t Y. 

i i =0 Vi =0 Vi =0 i w =0 " 
for i =l,...,Jf and p=2,...,W-l, 

£ ••• S ^ =1/ i w =l,...,M w , 

i i =0 ^-1=° 

[for i k =l,...,M k and k=2,...,N, 

6{0,1} for all ix,-,i N+1 ] 
where c 0 ... 0 is arbitrarily defined to be zero and is included 
for notational convenience. One can modify this formulation 
to include [ mul t ias signment s 1 multi-assignments of one, some, 
or all of the actual reports. The zero index is used in 
representing missing data, false alarms, initiating and 
terminating tracks as described in (A.B. Poore. 
Multidimensional assignments and multitarqet tracking, 
partitioning data sets, I.J. Cox, P. Hansen, and B. Julesz, 
editors, DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, American Mathematical Society, 
Providence, R.I., 19:169-198, 1995; A.B. Poore. 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor 
data fusion. Computational Optimization and Applications , 
3 : 27-57 , 1994 ) . In these problems, we assume that all zero- 
one variables z. ■ with precisely one nonzero index are 

- L I"' J -N 

free to be assigned and that the corresponding cost 
coefficients are well-defined. (This is a valid assumption in 
the tracking environment (A.B. Poore. Multidimensional 
assignments and multitarget tracking, partitioning data sets, 
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I.J. Cox, P. Hansen, and B. Julesz, editors, DIMACS Series in 



Discrete Mathematics and Theoretical Computer Science, 
American Mathematical Society, Providence, R.I., 19:169-198, 
1995; A.B. Poore. Multidimensional assignment formulation of 
data association problems arising from multitarqet tracking 
and multisensor data fusion. Computational Optimization and 
Applications, 3:27-57, 1994) . ) Although not required, these 
cost coefficients with exactly one nonzero index can be 
translated to zero by cost shifting (A.B. Poore and N. 
Riiavec. A lagrangian relaxation algorithm for 
multidimensional assignment problems arising form multitarget 
tracking. SIAM Journal of Optimization, 3, No. 3:544-563, 
1993) without changing the optimal assignment. Finally, this 
formulation is of sufficient generality to include the 
symmetric problem and the asymmetric inequality problem [.] 
(A.J. Robertson III. A class of lagrangian algorithms for the 
multidimensional assignment problem. Ph.D. Thesis, Colorado 
State University, Ft. Collins, CO, 1995). 

Amend the paragraph beginning at column 55, line 64, as follows: 

The data association problems in tracking that are 
formulated as Eguation ( f 1 . 1 1 4 . 1 ) have several 
characteristics. They are normally sparse, the cost 
coefficients are noisy and the problem is NP-hard (M.R. Galey 
and D.S. Johnson. Computers and Intractability. W.H. Freeman 
and Company, San Francisco, CA, 1979) , but it must be solved 
in real-time. The only known methods for solving this NP- 
hard problem optimally are enumerative in nature, with 
branch-and-bound being the most efficient; however, such 
methods are much too slow for real-time applications. Thus 
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one must resort to suboptimal approaches. Ideally, any such 
algorithm should solve the problem to within the noise level, 
assuming, of course, that one can measure this noise level in 
the physical problem and that the mathematical method 
provides a way to decide if the criterion has been met. 

Amend the paragraph beginning at column 56, line 10, as follows: 

There are many algorithms that can be used to construct 
suboptimal solutions to NP-hard combinatorial optimization 
problems. These include greedy (and its many variants), 
relaxation, simulated annealing, tabu search, genetic 
algorithms, and neural [netork] algorithms (C . H . 
Papadimitriou and K.Steiglitz. Combinatorial Optimization: 
Algorithm and Complexity. Prentice-Hall, Inc., Enqlewood 
Cliffs, NJ. 1982; J. Pearl. Heuristics: Intelligent Search 
Strategies for Computer Problem Solving. Addison-Wesley , 
Reading, MA, 1984; C.R. Reeves ed. Modern Heuristic 
Techniques for Combinatorial Problems. Halstead Press, Wiley, 
NY, 1993) . For the [three dimensional] three- dimensional 
assignment problem, Pierskalla (W. Pierskalla. The tri- 
substitution method for three-dimensional assignment problem. 
Journal du CORS , 5:71-81, 1967) developed the tri- 
substitution method, which is a variant of the simplex 
method. Frieze and Yadeqar (A.M. Frieze and J. Yadegar. An 
algorithm for solving 3-dimensional assignment problems with 
application to scheduling a teaching practice. Journal of the 
Operational Research Society, 39:989-955, 1981) introduced a 
method based on Lagrangian relaxation in which a feasible 
solution is recovered using information provided by the 
relaxed solution. Our choice of approaches is strongly 
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influenced by the need to balance real-time performance and 
solution quality. Lagrangian relaxation based methods have 
been used successfully in prior tracking applications [ . ] 
(K.R. P attipati, S. Deb, and Y. Bar-Shalom. A s-dimensional 
assignment algorithm for track initiation. In Proceedings of 
the IEEE Systems Conference, Kobe, Japan, pages 127-130, 
1992; Y. Bar-Shalom, S. Deb, K.R. Pattipati, and H. Tsanakis. 
A new algorithm for the generalized multidimensional 
assignment problem. In Proceedings of the IEEE International 
Conference on Systems, Math, and Cybernetics , Chicago, pages 
132-136, 1992; A.B. Poore and N. Riiavec. A numerical study 
of some data association problems arising in multitarget 
tracking. Large Scale Optimization: State of the Art, W.W. 
Eager, D.W. Hearn and P.M. Pardalos, editors. Kluwer Academic 
Publishers B.V., Boston, pages 339-361, 1994; A.B. Poore and 
N. Riiavec. Partitioning multiple data sets: multidimensional 
assignments and lagrangian relaxation. In P.M. Pardalos and 
H. Wolkowicz, editors. Quadratic assignment and related 
problems: DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, volume 16, pages 25-37, 1994; 
A.B. Poore and N. Riiavec. A lagrangian relaxation algorithm 
for multidimensional assignment problems from multitarget 
tracking. SI AM Journal of Optimization^, No. 3:544-563, 
1993) . An advantage of these methods is that they provide 
both an upper and lower bound on the optimal solution, which 
can then be used to measure the solution quality. These 
works extend the method of Frieze and Yadegar (A.M. Frieze 
and J.Yadegar. An algorithm for solving 3-dimensional 
assignment problems with application to scheduling a 
teaching practice. Journal of the Operational Research 
Society, 32:989-995, 1981) to the multidimensional case. 
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Amend the paragraph beginning at column 56, line 28, as follows: 

IV- 2 . Probabilistic Framework for Data Association. [ (ABP) ] 
The goal of this section is to explain the formulation 

of the data association problems that governs large classes 
of data association problems in centralized or hybrid 
centralized-sensor level multisensor/multitarget tracking. 
The presentation is brief; technical details are presented 
for both track initiation and maintenance in the work of 

[Poorel (A.B. Poore. Multidimensional assignments and 
multitarget tracking, partitioning data sets, I.J. Cox, P. 
Hansen, and B. Julesz, editors, DIMACS Series in Discrete 
Mathematics and Theoretical Computer Science, American 
Mathematical Society, Providence, R.I., 19:169-198, 1995; 
A.B. Poore. Multidimensional assignment formulation of data 
association problems arising from multitarget tracking and 
multisensor data fusion. Computational Optimization and 
Applications, 3:27-57, 1994) . The formulation is of 
sufficient generality to cover the MHT work of Reid, Blackman 
and Stein (S.S. Blackman. Multiple Target Tracking with Radar 
Applications . Artech House, Norwood, MA, 1986) and 
modifications by Kurien (T.Kurien. Issues in the designing of 
practical multitarget tracking algorithms. In Multitarget- 
Multisensor Tracking: Advanced Applications by Y. Bar-Shalom. 
Artech House, MA, 1990) to include maneuvering targets. As 
suggested by Blackman (S.S. Blackman. Multiple Target 
Tracking with Radar Applications . Artech House, Norwood, MA, 
1986) , this formulation can also be modified to include 
target features (e.g., size and type) into the scoring 
function. The recent work [of Poore and Drummondl (A.B. Poore 
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and O.E. Drummond. Track initiation and maintenance using 
multidimensional assignment problems. In D.W. Hearn, W.W. 
Hager, and P.M. Pardalos, editors. Network Optimization , 
volume 450, pages 407-422, Boston, 1996. Kluwer Academic 
Publishers B. V. ) significantly extends the work of this 
section to new approaches for multiple sensor centralized 
tracking. Future work will involve extensions to track-to- 
track correlation. 

Amend the paragraph beginning at column 56, line 44, as follows: 

The data association problems for multisensor and 
multitarget tracking considered in this work are generally 
posed as that of maximizing the posterior probability of the 
surveillance region (given the data) according to 

Maximize |p(r=Y| Z N ) | yer*^, ( [2.11 4.2 ) 

where Z N represents N data sets, y is a partition of indices 
of the data (and thus induces a partition of the data) , [T5 

r 

T5 y° 1 

[P(r=y|z N )] r* is the finite collection of all such 
partitions, T is a discrete random element defined on r*. and 
P(T = y\z N ) is the posterior probability of a partition y 
being true given the data Z N . The term partition is defined 
below; however, this framework is currently sufficiently 
general to cover set packings and coverings (A.B. Poore. 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor 
data fusion. Computational Optimization and Applications , 
3:27-57, 1994; A.B. Poore. Multidimensional assignments and 
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multitarget tracking, partitioning data sets, I.J, cox, P. 
Hansen, and B. Jules z, editors, DIMACS Series in Discrete 
Mathematics and Theoretical Computer Science, American 
Mathematical Society, Providence, R.I., 19:169-198, 1995). 

Amend the paragraph beginning at column 56, line 64, as follows: 

Consider N data sets Z{k) (Jc=l,...,N) each of M k reports 



respectively. In multisensor data fusion and multitarget 
tracking the data sets Z(k) may represent different classes 
of objects, and each data set can arise from different 
sensors. For track initiation the objects are measurements 
that must be partitioned into tracks and false alarms. In 
our formulation of track maintenance (A.B. Poore. 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor 
data fusion. Computational Optimization and Applications , 
3:27-57, 1994; A.B. Poore. Multidimensional assignments and 
multitarget tracking, partitioning data sets, I.J, cox, P. 
Hansen, and B. Julesz, editors, DIMACS Series in Discrete 
Mathematics and Theoretical Computer Science, American 
Mathematical Society, Providence, R.I., 19:169-198, 1995) , 
which uses a moving window over time, one data set will be 
tracks and remaining data sets will be measurements which are 




and let Z N denote the cumulative data set defined 



by 




( [2.2] 4^3) 
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assigned to existing tracks, as false measurements, or to 
initiating tracks. In sensor level tracking, the objects to 
be fused are tracks (S.S. Blackman. Multiple Target Tracking 
with Radar Applications . Artech House, Norwood, MA, 1986) . 
In centralized fusion (S.S. Blackman. Multiple Target 
Tracking with Radar Applications . Artech House, Norwood, MA, 
1986) , the objects may all be measurements that represent 
targets or false reports, and the problem is to determine 
which measurements emanate from a common source. 

Amend the paragraph beginning at column 57, line 14, as follows: 

We specialize the problem to the case of set 
partitioning (A.B. Poore. Multidimensional assignment 
formulation of data association problems arising from 
multitarget tracking and multisensor data fusion. 
Computational Optimization and Applications , 3:27-57, 1994; 
A.B. Poore. Multidimensional assignments and multitarget 
tracking, partitioning data sets, I.J. Cox, P. Hansen, and B. 
Julesz, editors, DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, American Mathematical Society, 
Providence, R.I., 19:169-198. 1995) defined in the following 
way. First, for notational convenience in representing 
tracks, we add a zero index to each of the index sets in 
Eguation ([2.21 4.3 ), a dummy report z k 0 to each of the data 
sets Z(k) in Eguation ( T21 4 . f 2 1 3) . and define a "track of 
data" as ^ z^, zf^ j , where i- k can now assume the [values] 
value of 0 [and respectively] . A partition of the data will 
refer to a collection of tracks of data wherein each report 
occurs exactly once in one of the tracks of data and such 
that all data is used up; the occurrence of dummy report is 
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unrestricted. The dummy report z* serves several purposes 
in the representation of missing data, false reports, 
initiating tracks, and terminating tracks (A.B. Poore. 
Multidimensional assignment formulation of data association 
problems arising from multitarget tracking and multisensor 
data fusion. Comvutational Optimization and Applications , 
3:27-57, 1994; A.B. Poore. Multidimensional assignments and 
multitarget tracking, partitioning data sets, I.J, cox, P. 
Hansen, and B. Julesz, editors, DIMACS Series in Discrete 
Mathematics and Theoretical Computer Science, American 
Mathematical Society, Providence, R.I., 19:169-198, 1995) . 
The reference partition is that in which all reports are 
declared to be false. 

Amend the paragraph beginning at column 57, line 28, as follows: 

Next under appropriate independence assumptions one can 
show (A.B. Poore. Multidimensional assignment formulation of 
data association problems arising from multitarget tracking 
and multisensor data fusion. Computational Optimization and 
Applications, 3:27-57, 1994; A.B. Poore. Multidimensional 
assignments and multitarget tracking, partitioning data sets, 
I.J, cox, P. Hansen, and B. Julesz, editors, DIMACS Series in 
Discrete Mathematics and Theoretical Computer Science, 
American Mathematical Society, Providence, R.I., 19:169-198, 
1995) 

p(r=Y|z N ) _ n 

P<r= Y °| Z ") = - u.-ijey Vv < C 2 -^> 

where y° is a reference partition, L ± v ..± l! is a likelihood ratio 
containing probabilities for detection, maneuvers, and 
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termination as well as probability density functions for 
measurement errors, track initiation and termination. Then 
if c V i„ = _lnI V* w ' 



P(r = Y °|Z N ) J (i,,.") 



( r2.41 4.5) 



Using Equation ([2.31 4.4 ) and the zero-one variable 
z i 1 -i„ 1 ^ f e Y and 0 otherwise, one can then write 

the problem ([2.11 4.4 ) as the following I\J-dimensional 
assignment problem: 

[ (2.5) ] 

Minimize E c . z. . 

i r ..i w 2r " iw 1v " 1n 

Subject To £ z i r ..i N =1 (i^l,...,*^) , (4.6) 

E. z i r ..i N =1 u 2 = i,-,m 2 ) , 

X) z i i =1 (i =1,...,M and p = 2, N-l) , 

i i- i P -iVi- i w v " ^ 

.E z V i w =1 (i N =1 — ' M N>' 

^...i/* 0 ' 1 * for all i ir ... r i N , 



where c 0 ... 0 is arbitrarily defined to be zero. Here, each 
group of sums in the constraints represents the fact that 
each-non-dummy report occurs exactly once in a "track of 
data." One can modify this formulation to include 
[multiassignments 1 multi-assignments of one, some, or all the 
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actual reports. The assignment problem Equation (T2.51 4.6 ) 
is changed accordingly. For example, if z* is to be 
assigned no more than, exactly, or no less than times, 
then the "=1" in the constraint ( \2 . 51 4 . 6 ) is changed to <, 
= , >n* k ," respectively. Modifications for group tracking and 
multi^resolution features of the surveillance region will be 
addressed in future work. In making these changes, one must 
pay careful attention to the independence assumptions that 
need not be valid in many applications. 

Amend the paragraph beginning at column 58, line 12, as follows: 

Expressions for the likelihood ratios L i 1 ,-, i N [ , ] can be 
found in the work of Poore (A.B. Poore. Multidimensional 
assignment formulation of data association problems arising 
from multitarget tracking and multisensor data fusion. 
Computational Optimization and Applications , 3:27-57, 1994; 
A.B. Poore. Multidimensional assignments and multitarget 
tracking, partitioning data sets, I.J, cox, P. Hansen, and B. 
Julesz, editors, DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, American Mathematical Society, 
Providence, R.I., 19:169-198, 1995) . These expressions 
include the developments of Reid, Kurien (T. Kurien. Issues 
in the designing of practical multitarget tracking 
algorithms. In Multitarget-Multisensor Tracking: Advanced 
Applications by Y. Bar-Shalom. Artech House, MA, 1990) , and 
Stein and Blackman (S.S. Blackman. Multiple Target Tracking 
with Radar Applications . Artech House, Norwood, MA, 1986) . 
What's more, they are easily modified to include target 
features and to account for different sensor types. In track 
initiation, the N data sets all represent reports from N 
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sensors, possibly all the same. For track maintenance, we 
use a sliding window of N data sets and one data set 
containing established tracks. (A. B . Poore. Multidimensional 
assignment formulation of data association problems arising 
from multitarget tracking and multisensor data fusion. 
Computational Optimization and Applications , 3:27-57, 1994; 
A.B. Poore. Multidimensional assignments and multitarget 
tracking, partitioning data sets, I.J, cox, P. Hansen, and B. 
Julesz, editors, DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, American Mathematical Society, 
Providence, R.I., 19:169-198, 1995). The formulation is the 
same as above except that the dimension of the assignment 
problem is now N+l. [@@@] 

Delete the paragraphs beginning at column 58, line 23, thru column 67, line 35: 

Amend the paragraph beginning at column 67, line 36, as follows: 

Overview of the Lagrangian Relaxation Algorithm. [ (ABP) ] 

Amend the paragraph beginning at column 67, line 36, as follows: 

Having discussed the N-dimensional assignment problem 
[(1.1)1 (3.1) , we now turn to a description of the Lagrangian 
relaxation algorithm. The algorithm will proceed iteratively 
for a loop k=l, . . ., N-2 . At the completion, there remains 
one two-dimensional assignment problem that provides the last 
step which yields an optimal (sometimes) or near-optimal 
solution to the original W-dimensional assignment problem. 
In step k of this loop (summarized in [Section 41 Section 
IV. 3 ) one starts with the following r (N-k+1)] (N-k+1) - 
dimensional assignment problem with one change in notation. 
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If k=l, then the index notation 1 2 and L 2 are to be replaced 
by i 2 and M lr respectively. 

[ (3.1) ] 



Minimize ^ E c^™. . .^z™. . .; N 

Subj ect To £ z . . iH = 1 , l k = l,...,L k , (4.7) 
for i p = l, . . . ,M p and p = k+2, . . . ,N-1, 

EN-k+l - . - 

^...i/* 0 ' 1 * all Vi w ,...,i M . 

To ensure that a feasible solution of Equation ([3.111 4.7 ) 
always exists for a sparse problem, all variables with 
exactly one nonzero index (i.e., variables of the form z*~q*1 

for [l k ,...,L k ] for h=l L „ and zq'-To-o for i p =l,...,M 1 and 

jo=k+l , . . . ,N) are assumed free to be assigned with the 
corresponding cost coefficients being well-defined. This 
assumption is valid in the tracking environment (A.B. Poore. 
Multidimensional assignments and multitarget tracking, 
partitioning data sets, I.J, cox, P. Hansen, and B. Julesz, 
editors, DIMACS Series in Discrete Mathematics and 
Theoretical Computer Science, American Mathematical Society' 
Providence, R.I., 19:169-198, 1995; A.B. Poore. 
Multidimensional assignment formulation of data association 

121 



problems arising from multitarget tracking and multisensor 
data fusion. Computational Optimization and Applications , 
3:27-57, 1994) . 



Amend the paragraph beginning at column 68, line 26, as follows: 

[Subsection 1 Section IV. 3.1 presents some of the 
properties associated with the Lagrangian relaxation of 
( r 3 . 1 1 4.7 ) based on relaxing the last (N-k) -sets of 
constraints to a two-dimensional one. [ A1 Section IV. 3. 2 
describes a new approach to the problem of recovering a high 
quality feasible solution of the original (N-k+1 ) -dimensional 
problem given a feasible solution (optimal or suboptimal) of 
the relaxed two-dimensional problem is described hereinafter. 
A summary of the relaxation algorithm is given [hereinafter] 
in Section IV. 3. 3 , [following which] and in Section IV. 3. 4, 
we establish the maximization of the Lagrangian dual (an 
important aspect of the relaxation procedure) to be an 
unconstrained nonsmooth optimization problem and then present 
a method for computing the subgradients . 

Amend the paragraph beginning at column 68, line 38, as follows: 

IV. 3.1 T-he Lagrangian Relaxed Assignment Problem [.] 
The (N-k+1) -dimensional problem ( T3.11 4.7 ) has (N-k+1) 
sets of constraints. A (M p +1 ) -dimensional multiplier vector 
(i.e., [u p ]uf 6 [RMp+ijR-P 11 ) associated with the [p-th]p_ th 
constraint set will be denoted by 

u p =(ug, uf, . . . , u£) T with = 0 being fixed for each p = k + 
2,...,N and included for notational convenience only. Now, 
the [ (N-k+1) dimensional] (N-k+1) -dimensional assignment 
problem ( f 3 . 1 1 4 . 7 ) is relaxed to a two-dimensional assignment 
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problem by incorporating (N-k-1) sets of constraints into the 
objective function via the Lagrangian. Although any {N-k-1) 
constraint sets can be relaxed, we choose the last (N-k-1) 
sets of constraints for convenience. The relaxed problem is 

[ (3.2) ] 

0 N _ k+1 (u k+2 r . . . ,u N ) = Minimize <p N _ k+1 (z w_jc+1 ; u k+2 , . . . u w ) = 



p=k+2 i p =0 p \l k i ktl - ViVi'" 1 " 

'SwV £ £ u 4 

p=Jc+2 i p =0 p 

£ fc < 



Subject To 2^ z 5wWi» =1 ' I Jt =1 "--V 



One of the major steps in the algorithm is the maximization 
of <P N k+1 (u k+2 , . . . , u N ) with respect to the multipliers 

[u k+2 , . . . , u N ) . It turns out that & N _ k+1 is a concave, 
continuous, and piecewise affine function of the multipliers 

{u k+2 , . . . , u N ) , so that the maximization of <l> N _ k+1 is a problem 
of nonsmooth optimization. Since many of these 
algorithms [[???] ] require a function value and a subgradient 
of <& N _ k+1 at any required multiplier value ( u k+2 , . . . , u N ) , we 
address this problem in the next subsection. We note, 
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however, that there are other ways to maximize 4> K 



N-k+l 



and the 



next subsection just addresses one such method. 

Amend the paragraph beginning at column 69, line 35, as follows: 

IV. 3. 2 Properties of the Lagrangian Relaxed Assignment 
Problem [ . ] 



an optimal (or suboptimal) solution of this relaxed problem 
( f 3 . 2 1 4 . 8 ) can be constructed from that of a two-dimensional 

assignment problem. Then, the nonsmooth characteristics of 
@ N - k+1 are addressed, followed by a method for computing the 

function value and a subgradient. 

Amend the paragraph beginning at column 69, line 43, as follows: 

Evaluation of & N _ k+1 . Define for each (l k ,i k+1 ) an index 
k+2 r- rju) ={jk+2(lkr i-k+i) r ■■ r ju^kr^k+i) ) _and a new cost function 



For a function evaluation of [<t> N _ k+ l] &^ 



N-k+l ' 



we show that 




[ (3.3) ] 




(4.9) 



2 _ 



+ t, uf p (l kf i k+1 ) for (l k ,± k+1 )*(0,0), 
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Given an index pair ( l kr i k+1 ) , ( j k+2 , . . . , j N ) need not be unique, 
resulting in the potential generation of several subgradients 
( [3. 111 4. 17 ) . Then, 

[ (3.4) ] 

<W"* +2 " w ) = 

Minimize <P N _ k+1 (z 2 ; u k+2 , . . . , u N ) 

• t t <;,.,<vr£ t < (4-10) 

1 k =0 i k*i =0 p=k+2 i p =0 p 

Subject To }2 z\ ± =1, 1=1, . . .L k , 

i i+1 = 0 * k+1 
l k =0 

z V fc+ i 6{0 ' 1} for a11 1 k' i k + i- 



As an aside, two observations are in order. The first is 
that the search procedure needed for the computation of the 
relaxed cost coefficients in ( [3.31 4.9 ) is the most 
computationally intensive part of the entire relaxation 
algorithm. The second is that a feasible solution z N ~ k+1 of a 
sparse problem ( [3.11 4.7 ) yields a feasible solution z 2 of 
([3.41 4.10 ) via the construction 

z 2 = I 1 ' if z WiW-i w = 1 for SOme {i *+2' - ' i w) ' 
* * +1 [0, otherwise. 

thus, there are generally solutions other than the one 
nonzero index solution. 

Amend the paragraph beginning at column 70, line 54, as follows: 

The following Theorem [3.11 4.1 gives a method for 
evaluating @ N _ k+1 and states that an optimal solution of 
( [3.21 4.8 ) can be computed from that of ( f3.41 4.10 ) . 
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Furthermore, if the solution of either of these two problems 
is 6-optimal, then so is the other. The converse is 
contained in Theorem ( [3.21 4.2 ) . 

Delete the paragraphs beginning at column 70, line 59, thru column 71, line 67, and replace 
them with the following new paragraphs: 

Theorem 4.1. Let w 2 be a feasible solution to the two- 
dimensional assignment problem (4.10) and define ^' k+1 by 

and (l k ,i k+1 )*(0,0) 
and (l k ,i k+1 )*(0,0) 

N-k+l -i . _ ff-Jt+1 , p n 

R+2 p=.fc+2 p 

Then w w " jc+1 is a feasible solution of the Lagrangian relaxed 
problem and 

0N-k + l ( W N "* +i / "* +2 , - . , U W ) = 0-jt-i ( ^2 / , . . . , u w ) . 

If, in addition, w 2 is optimal for the two-dimensional 
problem, then w* 1=k+1 is an optimal solution of the relaxed 
problem and ®N-k+i ( u k+2 , . . . r u N ) = 

S_ k+1 {u k+2 , . . . ,u N ) . 

Proof. Let w*^* 1 and w 2 be as in the hypotheses, and let 
4>N-k+i ( w N ~ k+1 ; u k+2 r . . . , u N ) and 
<P N -ku (z 2 ;u k+2 , . . . ,u N ) 
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denote the objective function values of (4.8) and (4.10), 
respectively. Direct verification shows that w N ~ k+1 satisfies 
the constraints in (4.8) and 

Q N - k+1 {^- k+1 ;u k+2 ; . . . ,u w ) = <p. k+1 {rf ;u k+2 ,...,u N ) . 
For the remainder of the proof, assume that w 2 is optimal for 
(4.10). Let x N ~ k+1 satisfy the constraints in (4.8) and define 



<i, tl =Ei M ... iN <t; 1 1 i Jt+2 -.i„ for u k ,i k+1 )+(o,o), 

x 0 2 0 = l if (Vi w ) = (0,0) and 

c o""i + + 2 - % + £ U C ^° for SOme (i *+2'"'' : 



(4.12) 



p=k+2 

x 0 2 0 = 0 if (l k ,i k+1 ) = (0,0) and 



+ 2^ "x p >0 for all (i k+2 

p=k+2 p 



Note that x 2 satisfies the constraints in (4.10) and 
0N-k+i ( * N ~ k+1 1 u k+2 , . . . , u N ) > <p_ k+1 ( x 2 ; u k+2 ,u N ) 

> <p n-k+i (w 2 ; uk+2 - « • • - uN ) 
= <t>»-k + i^- k+1 ;vP 2 , ■ ■ • ,u N ) 

for any feasible solution x N ~ k+1 of the constraints (4.8). 
This implies w w_jc+1 is an optimal solution of (4.8). Next, 

dW ( u k+2 , ...,u N ) = S N _ k+1 ( u k+2 , u N ) 
follows immediately from 

<P N - k +i ( w N "* +1 ;u k+2 , . . . , u N ) = <p N _ k+1 [tf;u k+2 , . . . , u N ) 
for an optimal solution w 2 of (4.10). With the exception of 
one equality being converted to an inequality, the following 
theorem is a converse of Theorem 4.1. 
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Theorem 4.2. Let v/ 1 '^ 1 be a feasible solution to problem (4.8) 
and define w 2 by 

^iU^.E. <i!l 1 i it+2 ---i N for u k ,± k+1 )*(o,o) , 

% = 1 if (l k ,i k+1 ) = {0,0) and (4.13) 
c ool + l~i„ + £ "i P ^0 for soine {i k+2 ,~, i w ) , 

p=Jc+2 p 

p/ 0 2 0 = 0 if (1^ =(0,0) and 

p=k+2 p 

Then w 2 a feasible solution of the problem (4.10) and 
Qu-k+i ( / u k+2 , . . . , u N ) > <p N _ k+1 ( w 2 ; u k+2 ,u N ) . 
If, in addition, w* 1 "^ 1 is optimal for (4.8), then w 2 is an 
optimal solution of (4.10), 

0 N - k+ i ( w w "^ +1 / u k+2 ,u N ) = <p N _ k+1 ( w 2 ; u k+2 ,u N ) and 
@N-k+i ( u k+2 , . . . , u N ) = S N _ k+1 ( u k+2 , . . . , u N ) . 
Proof: Let vf'^ 1 and w 2 be as in the hypotheses, and let 
0N- k+ i {^~ k+1 ;u k+2 , . . . ,u N ) and <p N _ k+1 ( w 2 ;u k+2 , . . . ,u N ) denote the 
objective function values of (4.8) and (4.10), respectively. 
Direct verification shows that w 2 satisfies the constraints 
in (4.10) and 

0N-k + i ( w N ' kfl ; u k+2 , . . . , u N ) > <p N . k+1 {w 2 ; u k+2 , . . . , u N ) . 
For the remainder of the proof, assume that vf'^ 1 is optimal 
for (4.8) and construct w 2 as above. Using Theorem 4.1, 
construct w N ~ k+1 by replacing w^ 1 in (4.11) with w N ~ k+1 . 
Then, from that theorem 
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0N- k+ i ( wN ' k+1 ru k+2 r . . . , u N ) =<p N . k+1 (w 2 ;^ 2 , . . . , u w ) 

< <p N _ k+1 ( w"-* +I ; u k+2 , . . . , u N ) . 
Optimality of w N ~ k+1 then implies the last inequality is in 
fact an equality. This proves the theorem. 

Amend the paragraph beginning at column 72, line 1, as follows: 

The Nonsmooth Optimization Problem. Next, we address 
the nonsmooth properties of the function [<t> N _ k+1 YU k+2 U n A] 
0M-^7 (u k+2 , . . . ,u N ) as explained in the following theorem. 

Amend the paragraph beginning at column 72, line 4, as follows: 

[Theorem 3.4 1 Theorem 4.3. (G.L. Nemhauser and L.A. 
Wolsey. Integer and Combinatorial Optimization, Section 
II. 3. 6. Wiley, New York, NY, 1988). Let [3> N _ k+1 ynA <JWiY N ~ k+1 ] 

be as defined in (4.7), let V ^.y^ ( z N " k+1 ) be the 
[object] objective function value of the (N-k+1 ) -dimensional 
assignment problem in [equation (3.1)] (4.7) corresponding to 
a feasible solution z N ~ k+1 of the constraints in [(3.1)] (4.7) , 
and let 

z N ~ k+1 be an optimal solution of [(3.1)] (4.7) . Then, [<V. k+ i 
yu k+2 U n A] $„. h1 (u k+2 , . . . , u N ) is piecewise affine, concave and 
continuous in [{u k+2 u N ] f u k+2 , . . . , u N } and 

Most of the algorithms for nonsmooth optimization are based 
on generalized gradients, called subgradients , given by the 
following definition for a concave function. 
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Amend the paragraph beginning at column 72, line 16, as follows: 

Definition [3. 5] 4^1. At u = ( u k+z , . . . , u N ) the set d$ N _ k+1 {u) 

is called a subdifferential of @ N _ k+1 and is defined for the 
concave function <P Nk+1 {u) by 

d <V*-i iu)={ge M M - +1 x ... x R* +1 1 ^ w ( w ) - ^ ( u) , ( 4 ' 15 > 
g T (w-u) for all we R Mk * 2+1 x ... x R M » +1 } , 

where g| > = ^o'=u^=0 are all permanently fixed. (Recall that 
these were used for notational conveience only.) A vector 
g e d<t> N _ k+1 is called a subgradient . 

Amend the paragraph beginning at column 72, line 25, as follows: 

There is a large literature on such problems, e.g., 
(J.-B. Hiriart-Urruty and C. Lemarechal. Concex Analysis and 
Minimization Algorithms I& II. Springer-Verlag, Berlin, 1993; 
K.C. Kiwiel. Methods of descent for nondif f erentiable 
optimization. In Lecture Notes in Mathematics 1133, A. Dold 
and B. Eckmann, eds . Springer-Verlag, Berlin, 198 5; 
C. Lemarechal and R. Mifflin. Nonsmooth Optimization. Pergamon 
Press, Oxford, UK, 1978; B.T. Polvak. Subgradient method: 
A survey of Soviet research. In C. Lemarechal and R. Mifflin, 
editors, Nonsmooth Optimization, pages 5-29, N.Y., 1978. 
Pergamon Press.; H. Schramm and J. Zowe. A version of the 
bundle idea for minimizing a nonsmooth function: Conceptual 
idea, convergence analysis, numerical results. SI AM Journal 
on Optimization, 2, No . 1 : 121-152 , February, 1992; N.Z. Shor. 
Minimization Methods for Non-Pi ff erentiable Functions . 



Springer-Verlag, Nem York, 1985; P.Wolfe. A method of 



conjugate subgradients for minimizing nondif f erentiable 
functions. Mathematical Programming Study, 3:145-173, 1975), 
and we have tried a variety of methods including subgradient 
methods (N.Z. Shor. Minimization Methods for Non- 
Pi ff erentiable Functions . Springer-Verlag, New York, 1985) 
and bundle methods (J.-B. Hiriart-Urruty and C. Lemarechal. 
Convex Analysis and Minimization Algorithms I& II. Springer- 
Verlag, Berlin, 1993; K.C. Kiwiel. Methods of descent for 
nondif f erentiable optimization. In Lecture Notes in 
Mathematics 1133, A. Dold and B. Eckmann , eds . Springer- 
Verlag, Berlin, 1985) . Of these, we have determined that for 
a fixed number of nonsmooth iterations (e.g., twenty), the 
bundle trust method of Schramm and Zowe (H.Schramm and J. 
Zowe. A version of the bundle idea for minimizing a nonsmooth 
function: Conceptual idea, convergence analysis, numerical 
results. SI AM Journal on Optimization, 2, No. 1:121-152, 
February, 1992) provides excellent guality solutions with 
the fewest number of function and subgradient evaluations, 
and is therefore our currently recommended method. 

Amend the paragraph beginning at column 72, line 33, as follows: 

An Algorithm for Computing & N _ k+1 and a Subgradient. 
Most current software for maximizing the concave function 
^N-k+i requires the value of the function and a subgradient at 
a point ( u k+2 , . . . , u N ) . Based on the previous two sections, 
this can be summarized as follows. 

1. Starting with problem ( [3.11 4.7 ) , form the relaxed 
problem ( r 3 . 2 1 4 . 8 ) ; 
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2. To solve ( f 3 . 2 1 4 . 8 ) optimally, defined the two- 
dimensional assignment problem ( [3.41 4.10 ) via the 
transformation ([3.31 4.9 ); 

3. Solve the two-dimensional problem ( \3 . 4 1 4 . 10 ) 
optimally; 

4. Reconstruct the optimal solution, say ft N ~ k+1 , of 
([3.2]4_J1) via equation ([3.5]4^9) as in Theorem \3. 11 4 . 1; 

5. Compute the function 

* w -* + i < u * +2 ' • • • ' u w > s "* +2 * 

p=k+2 i p =o p [v^i-ViVi-^ J 

A subgradient is given by 

[ (3.11) ] 

p du/ [ i t I wViVi" 1 » J 

fori = 1, ...,M and p = k+2, . . . ,N. 



Several remarks are in order. First, the optimal solution of 
the minimization problem ([3.21 4.8 ) is required before one 
can remove the minimum sign, replace z N ~ k+1 by the minimizer 
^~ k+1 and differentiate with respect to u[ to obtain a 
subgradient as in ( T3 . Ill 4 . 17 ) . If $*~ k+1 is an approximate 
solution of ([3.21 4.8 ), then the subgradient and function 



[ (3.10) ] 
(4.16) 
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values are only approximate with [accruacy] accuracy depending 
on that of w N_A:+1 . Although one can evaluate the sums in 
( [3.101 4. 16 ) and ( \3. Ill 4.17 ) in a [straightforward] straight 
forward manner, another method is based on the following 
observation. Given the multiplier vector (u k+2 , . . . , u N ) , let 
{{l k (l k+1 ) i i k+1 (l k+1 ) )}^* +1 _ 0 be an enumera tion of indices |l k ,i k+1 J 
of w 2 (or the first 2 indices of w N ~ k+1 constructed in 
eguation \3 . 51 4 . 9 ) ) such that_wf (I )fi (1 } = 1 for 

and (l k (l kll ) . ij ^(1^^) ) = (0,0) for l kll = 0 regardless of 
whether 

w 0 2 0 = l or not. (The latter can only improve the recovered 
feasible solution.) The evaluation of the bracketed quantity 

in ( [3.111 4.17 ) for a specific i p z 1 and [p=k+21 p = k+2 N 

is one minus the number of times the index value i p appears 
in the (p-k+l) th position of the ( [N-k+1) -tuple in the list 

Amend the paragraph beginning at column 73, line 19, as follows: 

Finally, we have presented a method for computing one 
subgradient. If i^"** 1 is the unique optimal solution of 
([3.21 4.8 ), then @ N . k+1 (u) is dif f erentiable at u, g is just 
the gradient at u, and the subdif f erential3^ H _ J[ . + 1 ( u) = { g) is a 
singleton. If, corresponding to u, ^' k+1 is not unique, then 
there are finitely many such solutions, say 
{i^-^ 1 (i) , . . . f ^~ k+1 ( m ) } with respective subgradients 
{g (1) , . . . ,g (m) } , the subdif ferential d^(u)is the convex hull 
of { a (1) , . . . ,g (m) } (J.L. Goffin. On convergence rates of 
subgradient optimization methods, mathematical programming. 
Mathematical Programming, 13:329-347, 1977) . These nonunique 
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solutions arise in two ways. First, if the optimal solution 
of the [two dimensional] two-dimensional assignment problem is 
not unique, then one can [general] generate all optimal 
solutions of the [two dimensional] two-dimensional assignment 
problem (f3.41 4.10 ). Corresponding to each of these 
solutions and to each index pair ( l k , i k+1 ) in each solution, 
compute the indices [j k+2 ,...,j ll ) in ( \3 . 3] 4 . 9 ) . If these j's 
are not unique, then we can enumerate all the possible 
optimal solutions t^** 1 of ([3.21 4.8 ). Given these 
solutions, one can then compute the corresponding 
subgradients from ([3.111 4.17 ). 

Amend the paragraph beginning at column 73, line 38, as follows: 

In most nonsmooth optimization algorithms, one uses an 
[epsilon-subdif ferential] e-subdif ferential . 

Amend the paragraph beginning at column 73, line 40, as follows: 

Definition [3.x] 4.2 . At u = (u k+2 , . . . , u N ) the set d e & N _ k+1 (u) 
is called an [epsilon subdif ferential ] e-subdif ferential of 
^N-k+i anc * ^ s defined for the concave function & N _ k+1 (u) [ (u) ] 
by 

d e^- k+ i^ = * Sr 6 R M ^ +1 x ... x 1 0 N _ k+1 (w) - 0 N _ k+1 (u) * 
g T (w-u) + e for all w el %2+1 x . . . x 

where g^=w^ = u^=0 are all permanently fixed. (Recall that 
these were used for notational convenicence only.) A vector 
g E d e 0 N _ k+1 (u) is called [a subgradient] an e-subgradient . 
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Delete the paragraph beginning at column 73, line 49. 

Amend the paragraph beginning at column 73, line 50, as follows: 

IV. 3. 3 The Recovery Procedure. 
The next objective is to explain a recovery procedure, i.e., 
given a feasible (optimal or suboptimal) solution [co 2 YAYW N " k+1 
yAl w 2 of (4.10) (or p/ 7 "^ 1 of (4.8) constructed via Theorem 

[3.11 4.1 ) , generate a feasible solution z N ~ k+1 of equation 

( T 3 . 1 1 4 . 7 ) which is close to [co 2 ] w 2 in a sense to be 
specified. We first assume that no variables in ( [3.11 4.7 ) 
are [presassigned] vreassicrned to zero; this assumption will 
be removed shortly. The difficulty with the solution [co N ~ 
k+i i yjN-k+i in Theorem [3.11 4.1 is that it need not satisfy the 
last (N-k-1) sets of constraints in ([3.11 4.7 ). (Note, 
however, that if [co 2 l w 2 is an optimal solution ([3.41 4.10 ) 
and [ oo N " k+1 l w^~ k+1 , as constructed in Theorem 4.1, satisfies the 
relaxed constraints, then [co N_k+1 vAAcol w N ~ k+1 is optimal for 

(4.7).) The recovery [proceudrel procedure described here is 
designed to preserve the 0-1 character of the solution [co 2 
vAl ur 2 of (4.10) as far as possible: If 

[u 2 lkik+i = l and l k *0or i k+1 *0] , w*i =1 and l k *0 or i k+1 *0 
the corresponding feasible solution z N ~ k+1 of ( [3.11 4.7 ) is 
construed so that z"^** 1 .^ =1 for some (i k+2 , . . . , i N ) . By this 
reasoning, variables of the form z ( ^~* +1 .. i can be assigned a 
value of one in the recovery problem only if [ooo 0 = l] Wq 0 = 1 . 
However, variables z^ - ** 1 .^ will be treated differently in the 
recovery procedure in that they can be assigned either zero 
or one independent of the value [of] [<»o 0 = l] w 0 2 0 . This 



135 



increases the feasible set of the recovery problem, leading 
to a potentially better solution. 



Amend the paragraph beginning at column 74, line 4, as follows: 

Let | {l k [l k+1 ) , i k+1 (l k+1 ) }^ +1 _ 0 k e an enumeration of indices 
{l k , i k+1 } of w 2 (or the first 2 indices of Too 2 y co N " k+1 1 w N ~ k+1 
constructed in equation [(5)1 (4.11) ) such that 

d k (l k+1 ) , i k+1 U k+1 ) )* (0,0) and 
d k (l k+1 )ri k+1 {l k+1 )) = (0,0) for l k+1 =0 
regardless of whether [a>o 0 = l] w 0 2 0 = 1 or not. To define the 
[N-k dimensional] (N-k) -dimensional assignment problem that 
[resores] restores feasibility, let 

[ (3.12) ] 



°I i (l 2 )i 2 (I 2 )i 3 . . .i„ 



(4.18) 



ii < 2 2 . . . *+l > i 2 < h . . . k+l ' i 3 ( 2 3 . . . k+1 ' • • • i k < L kk*l > < 2 A + 1 > ijt +2 • 

for k>2 and 1=0,..., L , 



where 

2 - . . . * + i = K 0 • • • 0 h ( > = ( < - ( h ( ) ) - ) ) (4-19) 



for m = 2,...k+l and where f o 1 "°" denotes function 
composition. For example, 1 23 = 1 2 {1 3 ) and 1 234 = 1 2 °1 3 (1 4 ) = 
1 2 (1 3 (1 4 )). 
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Amend the paragraph beginning at column 74, line 24, as follows: 



Then the (N-k) -dimensional assignment problem that 



restores feasibility is [ 
Minimize £ c?\ L zf \ ± 
Subject To X). z 2^W-.i» =1 ' 1 k+ x = 1 '---' L k ^ 
^ .E . zTZi^.-.i^ 1 ' ** + 2 = 1 '---' M *+ 

for i p = l, • - - ,M p and p = k+3, . . . ,N-1, 
.E . <"i i+2 ...i N -l, i w =l,...M N/ 

z W w -i» e{0 ' 1} for all 1^,1^,. 



(3.14) ] 



(4.20) 



Let Y be an optimal or feasible solution to this [N - k 1 C IV— 
k) - dimensional assignment problem. The recovered feasible 
solution z N is defined by [ (3.14) ] 

1, if Wl;,...^), W^...^)' 

W-^.. .*♦!>'•■•' W-W' (4-2i) 

^♦l^Jfc+lf-w and y iJt+1 i, +2 ...i N =1 ' 

0, otherwise. 



Said in a different way, the recovered [reasiblel feasible 
solution [z N ]z^ corresponding to the multiplier set 
{ u k+2 , . . . , u N } is then defined by 
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J 1 ' if Y w^i„ =1 ' 

I 0, otherwise, 



where l m ... k+1 is defined in ([3.131 4.19 ) and \°] "°" denotes 
function composition. 

Amend the paragraph beginning at column 75, line 1, as follows: 

The next objective is to remove the assumption that all 
cost coefficients are defined and all zero-one variables are 
free to be assigned. We first note that the above 
construction of a reduced dimension assignment problem 
(r3.141 4.20 ) is valid as long as all cost coefficients c N ~ k 
are defined and all zero-one variables in z N ~ k are free to be 
assigned. Modifications are necessary for sparse problems. 
If the cost coefficient Ci'u^) ± ktl (i k+1 ) i k+2 -~i N is well-defined and 
the zero-one variable z T k {i kl )± k 1 (i k 1 )i Jt 2 -i N i- s free to be assigned 
to zero or one, then define cf~ k i ..^ = cf'^ 1 }i (I }i „ mi as in 
( [3 . 121 4 . 18 ) with z i~*i k 2 ~i N being free to be assigned. 
Otherwise, z i k *i k 2 -i N ^ s preassigned to zero or the 
corresponding arc is not allowed in the feasible set of arcs. 
To ensure that a feasible solution exists, we now only need 
ensure that the variables z^~ k 0 ... Q are free to be assigned for 
l k+1 =0 , 1, L k+1 with the corresponding cost coefficients being 
well-defined. (Recall that all variables of the form zf~ k *^ 
and ZQ... k l\.. Q are free (to be assigned) and all coefficients 
of the form cf^ 1 and 

c o-o1\-q are well-defined for [l k =0] l k =Q,...,L k and [i p =0]i p 
=0,...,M p for p=k+l ,N.) This is accomplished as follows: If 
the cost coefficient c_f~ ( * + * }i + (i )0 ... 0 is well-defined and 

N-fc+l £ n j~ i II- k N-k+l 

^(WW-WO-o 1S free ' then define c ^ +1 o-o = c i t (i M )i w (i w )o...o 
with z_f * 0 ... 0 being free. Otherwise, since all variables of 
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the form zf qSq and Zo'i^o-o are free to be assigned with the 
corresponding costs being well-defined, set cf _Jc 0 ... 0 = 
c i (i + ) oo-o + c oi* + (i >o-o-£- where the first term is omitted if 
1 k( 1 k+i) =lQ and tne second, if i k+1 (l k+1 ) =0 . For l k (l k+1 )=0 and 
i k +i(l k +i)=0, define c 0 ^ 0 * = c 0 w ; o * +1 . 

IV. 3. 4. The last step k = N-2. 

The description of the algorithm ends with fk=N+21 k = 
N±2. The resulting recovery problem defined in ( [3 . 141 4 . 20 ) 
with [k=N-2 l Jc = N-2 is 

& = Minimize J, J2 c\ ± z\ ± =VAz 2 ) 

Vl = 0 i M =0 W W-1 N 

Subject To X) ^ i =1, 1^ = 1,...,!,^, (4.22) 

i N =0 

Vi =0 

z^^ e {o,l} for all 1 N _ X , i ff . 

Let Y be an optimal or feasible solution to this [2- 

dimensional] two-dimensional assignment problem. The 

recovered feasible solution z N is defined by 

f 1, if i x = 1,(1^), i 2 = i 2 (l 2 _^), i^i 3 {l M ),..., 

f » J V2 = V2(Wl)'Vl = i N-l(Vl' andr i N1 i w =1 

V2Vii ' or if d N _ lf i N ) = (0,0), 

[ 0, otherwise. 

( f3. 181 4.23 ) 

Said in a different way, the recovered feasible solution z N 
is then defined by 
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1, if Y lailK =l, (4.24) 

^(Vm) i 2 (J 2 ..„) i 3 (i 2 . H ) ...i M _ 2 ( Vsw-i) Vi < Vi> ijr = 1 

I 0, otherwise. 



[ (3.19) ] 

where 2 m ... ff _ 2 is defined in ( T3 . 13 1 4.19 ) and f°l "°" denotes 
function composition. To complete the description, let 
I (2^ (l w ) , i N (l N ) }^ w =o be an enumeration of indices [l N _ lf i N \ of 
Y 

such that r VlUH ,, JirUw) =l for (l^ (l w ), ^ (0,0) and 

(l 1 ^ 1 (l H ),i w {2 H ))= (0,0) for 1 N =0 regardless of whether Y 00 =l or 
not. Then the recovered feasible solution can be written as 
f 1 , if !, = !,( 1 2 „J ,i 2 = i 2 ( 1 2 _ N ) , i 3 = i 3 ( l 3 ... N ) , ... , 

*w,-i» = j VrVitU)^^ 1 ^ 1 ,) ? (4-25) 

I 0, otherwise. 
Amend the paragraph beginning at column 76, line 21, as follows: 

IV. 3. 5. The Upper and Lower [Bound. ] Bounds 
The upper bound on the feasible solution is given by 

V N ( * ") = £ ([3.21] 4.26 ) 

and the lower by [<§ N ] @ N (u 3 , ... , u N ) for any multiplier value 
{u 3 r ...,u N ). In particular, we have 

& N {u 3 ,...,u N ) fS <P N (u 3 ,...,u N ) z V N {z N ) <; V w (£ w ), ( T3. 221 4.27 ) 

where {u 3 ,...,u N ) is any multiplier value, (u 3 ,...,if) is a 
maximizer of [<$ N ]$ N { u 3 ,..., u N ) , z w is an optimal solution of the 
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multidimensional assignment problem ([3.11 4.7 ) and z N is the 
recovered feasible solution defined by ( 1 3 . 20 1 4 . 25 ) . 
Finally, we conclude with the observation that V N (t) =V 2 (Y) 
where Y is the optimal solution of ([3.171 4.23 ) used in the 
construction of £ in equations (13. 181 4. 24 ) - ( T3 . 201 4.26 ) . 

Amend the paragraph beginning at column 76, line 36, as follows: 

IV. 3 . 6 . Reuse of Multipliers [. ] 

Since the most computationally expensive part of the 
algorithm occurs in the maximization of <P N . k+1 , the 
development of algorithms that can make use of hot starts or 
multipliers close to the optimal are fundamentally important 
for real-time speed. The purpose of this section is to 
demonstrate that the multiplier set obtained at stage k>l 
provide good starting values for those obtained at step k+1 . 
Theorem [3.xx] 4.4 . Let (u 3 ,...,u N ) denote a multiplier set 
obtained in the [maximum 1 maximization of @ N [ (] (u 3 ,...,u N ) . 
Then this multiplier set satisfies the string of inequalities 

$ N (u 3 , ...,u N ) ^^ w _ 2 (u 4 , . . .,u w ) s . . . z0 3 (u N ) <$ 2 <,V N (z) , (4.28) 

where after the first step in the maximization of @ H the 
multipliers are not changed in the remaining steps. 
Furthermore,, to improve this inequiality, let 
(u 2+k ' N ~ k+1 ,... r u NrN ' k+1 ) denote a maximizer of ( u k+2 , u N ) . 

Then, we have 
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.(u** 2 , . . .,u w ) ^0 N _ k+1 {u 2+k ' N - k+1 r . ..,u N ' N - k+1 ) (4.29) 
z* N _ k (u 3+k ' N - k+1 ,...,u N ' N - k+1 ) 
z$ N k (u 3+k ' N - k , . ..,u N ' N - k ) 
± . . .±<P 3 (u N ' 3 ) Z0 2 ±V N (2) . 



[ (3. xxx)] 

Amend the paragraph beginning at column 76, line 64, as follows: 

[ Inequalities depend on solution of 2d assignment 
problem. ] 

Proof: Suppose we have a value of the multipliers ( u k+2 , u N ) 
obtained in the maximization of 



& N _ k+1 (u k+2 , ... ,u N ) = Minimize <t> N _ k+1 (z N ~ k+1 ; u k+2 , . . . , u N ) (4.30) 
Subj ect To X) z vl + X +2 ■ • ■ ±„ = 1 ' 1 k = 1 ' • • • L k' 

where [ (3 . xx) ] 

<P N „ k+1 (z N - k+1 ;u k+2 ,...,u») 

p= Jt+2 i p =0 I l k i k+1 . . -ip-ii p+1 - ■ -i w I 

l k i k+1 ...i N |^ p=Jc+2 P J p=.fc+2 i p =0 p 
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Amend the paragraph beginning at column 77, line 24, as follows: 



These need not be the maximizer ; however, we do assume that 
we have solved the above minimization problem optimally to 
evaluate & N _ k+1 ( u k+2 , u N ) . Just as in the definition of the 
[earlier ] recovery proble m discussed earlier , let 
\(l k (l k+1 ) r i k+1 (l k+1 ) ) fi =o be an enumeration of indices 
{ l k ,i k+1 [ ) ]1 of the optimal solution w 2 of problem ( T3. 41 4 . 10 ) 
(or the first 2 indices of the solution Tw N = k+1 l w N ~ k+1 of the 
relaxed problem ( [3.21 4.8 ) constructed in equation 
(T3.51 4.ll ) such that (I }/i (1 } =1 for 

(V-W >^h^)* (0,0) and (l k (l k+1 ),i k+1 (l k+1 ))=(0,0) for l k+1 =0 
regardless of whether w 2 0 -l or not. 

Amend the paragraph beginning at column 77, line 34, as follows: 

Then, the final value of the objective function can be 
expressed as 

0 (u k+2 . ,u) = 

Minimize <p N _ k+1 (z N - k+1 ;u k+2 ,...,u N ) (4.32) 

Subject to _£ zX, lw | Iw , wll =l, l k+1 = l,...,L k+1 , 

where 

<P n - k+1 (z N ~ k+1 ;u k+2 ,...,u N ) = (4.33) r (3. xxx) ] 

i . [ C -I J: (^ + i)ii + i(-Ii r+ i)ijt + 2"- i Ir + U ^ 3 ] Zl Jfc(- I ^l) i i: + l(- I lr + l) i *: + 2- i W 

-I £<• 

p=/c+2 i p =0 
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If now another constrain set, say the (k+2) th set, is added 
to this problem, one has 



S N=k+1 {u k+2 ,...u N ) = Minimize <P N _ k+1 {z N ~ k+1 } u k+2 , u N ) = (4.34) 
Minimize £ {<(t\>WW-i. + t < l^) W 

h+lh+^N [ P =k+2 J 

" t t < 

p=k+2 i p =0 p 

Subject to ^ i ^Xii^iWWir 1 ' h+i^'-'h+i' 

E N-k+l _~ . _~ 

x i _ J ^l^itiwIVitW^K ' 2 *+2 - 1 ' - ' M k+2 ' 

Amend the paragraph beginning at column 78, line 8, as follows: 

Since the constraint £ z i~u 1 \i ti )i i = 1 f° r 

i tn i, t3 -i„ * * +1 * +1 * +1 k * 2 N 

i k+2 =l, -,M k+2 is now imposed, the feasible region is smaller, 
so that one has 

$ N - k+1 (u k+2 '~'U N ) * & N „ k+1 (u k+2 ,... r u N ) 
s * N . k+1 (u k+3 f ...,-u») 
s ^ k+1 (u k+ \...,u»), 

where the fact that & N=k+1 does not depend on the multiplier 
set u K+2 due the added constraint set. Also, the last 
equivalence follows from the fact that [® N=k+1 ] ® N=k+1 ( u k+3 , u N ) 
is the relaxed problem[ (3.xx)] (with k replaced by k+1) for 
the recovery problem[ (3.xx)] in step A" of the above 
algorithm. Continuing this way, one can compute {u 3 ,...,u N ) at 
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the first step (k=l) , fix them thereafter, and perform no 
optimization at the subsequent steps to obtain 

0 N (u 3 ,...,u N ) * ^(u*,. ..,u») *~£<P 3 (u w ) <,® 2 =V N {2), 
where <t> 2 i- s defined in ( 4.22 ) . 

Amend the paragraph beginning at column 78, line 25, as follows: 

To explain how to improve this inequality, let 
(u 2+k ' N - k+1 ,...,u N ' N - k+1 ) denote a maximizer of ® N _ k+1 ( u k+2 , u N ) . 
Then by the same reasoning one has l"(3.xx)1 the result as 
stated in the theorem. [Q.E.D.] 

Amend the paragraph beginning at column 78, line 29, as follows: 

V. Summary of the Lagrangian Relaxation Problem 
Given the multidimensional assignment problem 

[(4.1)] 

Minimize c ± i z i ± 

Subject To £ z i 1 ...i N =1 ■ ■ -M^ , (5.1) 

. z i 1 ...i N =1 (i 2 = l/..-^), 

z. . =1 {i=l,...M n and p = 2, . . . , N-l) , 

i 1 ...i p . 1 i p+1 ...i N p p 

i 1 i 2 . . .i^ 

... ljf 6 {0,1} for all i lf . . . i w , 

where c 0 w . 0 is arbitrarily defined to be zero and is included 
for notational convenience and where the superscript N on 
both c and z is not an exponent, but denotes the dimension of 
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the subscripts and the assignment problem as stated in 
( 12 . 51 3 . 5 ) . In relaxed and recovery problems c 0 w . 0 need not be 
zero! In this problem, we assume that all zero-one variables 
z"..^ with precisely one nonzero index are free to be assigned 
and that the corresponding cost coefficients are well- 
defined. (This is a valid assumption in the tracking 
environment (A.B. Poore. Multidimensional assignments and 
multitarget tracking, partitioning data sets, I.J. Cox, P. 
Hansen, and B. Julesz, editors, DIMACS Series in Discrete 
Mathematics and Theoretical Computer Science, American 
Mathematical Society, Providence, R.I., 19:169-198, 1995; 
A.B. Poore. Multidimensional assignment formulation of data 
association problems arising from multitarget tracking and 
multisensor data fusion. Computational Optimization and 
Apylications, 3:27-57, 1994) . ) Although not required, these 
cost coefficients with exactly one nonzero index can be 
translated to zero by cost shifting (A.B. Poore and N. 
Rijavec. A lagrangian relaxation algorithm for 
multidimensional assignment problems arising from multitarget 
tracking. SIAM Journal of Optimization, 3, No. 3:544-563, 
1993) without changing the optimal assignment. 

Amend the paragraph beginning at column 78, line 61, as follows: 

Having explained many of the relaxation features, it is 
now appropriate to present the Lagrangian relaxation 
algorithm, which iteratively constructs a feasible solution 
to the A/'-dimensional assignment problem ( T4 . 11 5 . 1 ) ♦ 
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Amend the paragraph beginning at column 78, line 65, as follows: 

Algorithm [4 . 1] 5 . 1 (Lagrangian Relaxation Algorithm) [. ] 
To construct a high quality feasible solution, 
[enoted] denoted by z N , of the assignment problem ([4.11 5.1 ) , 
proceed as follows: 

0. Initialize the multipliers (u k+2 , u N ) , e.g., 
(u* +2 ,...,u w ) = (0,...,0) . 

For k-l,...,N-2, do 

1. For the Lagrangian relaxed problem ((3.21 4.8 ) from the 
problem ((3.11 4.7 ) by relaxing the last (N-k-1) sets of 
constraints . 

2. Use a nonsmooth optimization technique to solve 

[(4.2)] 

Maximize {(p N _ k+1 \u p eR Mp+1 for p = k+2, ...,N (5.2) 
with u 0 p =0 being fixed}, 

where <t> l] _ k+1 ( u k+2 , u N ) is defined by equation ( [3.21 4.8 ) . 
The algorithm [following problem (3.9) 1 in Section IV. 3. 2 
provides one method for computing a function value and a 
subgradient out of the subdifferential at ( u k+2 , u N ) , as 
required in most nonsmooth optimization techniques . 

3. Given an approximate or optimal maximizer of ([4.21 5.2 ) , 
say {Q k+2 , - , # w ) , let [w 2 1 w 2 denote the optimal solution 
of the two-dimensional assignment problem ([3.41 4.10 ) 
corresponding to this maximizer of @ N _ k+1 ( u k+2 , u N ) . 

4. Formulate the recovery (N-k) -dimensional problem 
([3.131 4.19 ) , modified as discussed at the end of 
subsection [(3.3) (IV. 3.2) for sparse problems . At this 
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stage, z N ^_ as defined in ( [3 .151 4 .21 ) , contains the 

alignment of the indices { i lf ... , i k+1 } . 
Formulate the final two-dimensional problem ( [3 . 17] 4 .22 ) and 
complete the final recovered solution ± N as in ( [3.20] 4 .25 ) . 

Amend the paragraph beginning at column 79, line 30, as follows: 

To explain the lower and upper bounds, let & N be as 
defined in ([3.2]jL_8) with k=l, let V N (z N ) be the objective 
function value of the i\f-dimensional assignment problem in 
equation ([2.51 3.5 ) corresponding to a feasible solution z N of 
the constraints in ( [2 . 51 3 . 5 ) , and let z N ~ k+1 be an optimal 
solution of ([2. 5] 3^5). Then, 

<P N (u 3 ,...,u N ) z VJz N ) z V N (2 N ) ([4.3]5 i 3) 

is the desired inequality. 

Amend the paragraph beginning at column 79, line 41, as follows: 

COMMENTS : 

1. Step 2 is the computational part of the algorithm. 
Evaluating <P N - k+1 and computing a subgradient used in the 
search procedure requires 99% of the computing time in 
the algorithm. This part uses [two dimensional] two- 
dimensional assignment algorithms, a search over a large 
number of indices, and a nonsmooth optimization 
algorithm. It is the second part (the search) that 
consumes 99% of the computational time and this is 
almost entirely parallelizable . 

2. In track maintenance, the warm starts for the initial 
multipliers for the first step are available. For the 
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relaxation procedure, initial multipliers are available 
in step 2 from the prior step in the algorithm. 
3. There are many variations on the above algorithm. For 
example, one can compute a good solution on the first 
pass (k=l) and not perform the optimization in (2) 
thereafter. This yields a great solution. Thus one can 
continue the optimization at the first pass, and 
immediately compute quality feasible solutions to the 
problem. 

Amend the paragraph beginning at column 79, line 64, as follows: 

VI. Laqrangian Relaxation Algorithm for the 3- 
Dimensional Algorithm. [ (ABP) ] 

In this section, we illustrate the relaxation algorithm 
for the [three dimensional] three-dimensional assignment 
problem. Having discussed the general relaxation scheme, 



Minimize 



Subject To 




z... e(0,l) for all i 1 i 2 i 3 . 
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To ensure that a feasible solution of ([5.11 6.1 ) always 
exists for a sparse problem, all variables with exactly one 
nonzero index (i.e., variables of the form z iQQl z QiQ , and z QOi 
for i p =l,...,M p and p=l,2,3 are assumed free to be assigned with 
the corresponding cost coefficients being well-defined]_. 
This assumption is valid in the tracking environment 
[ [**refPoa, **ref Pobl . 1 (A. B. Poore. Multidimensional 
assignments and multitarget tracking, partitioning data sets, 
I.J. Cox, P. Hansen, and B. Julesz, editors, DIMACS Series in 
Discrete Mathematics and Theoretical Computer Science, 
American Mathematical Society, Providence, R.I., 19:169-198, 
1995; A.B. Poore. Multidimensional assignment formulation of 
data association problems arising from multitarget tracking 
and multisensor data fusion. Computational Optimization and 
Applications, 3:27-57, 1994). 

Amend the paragraph beginning at column, 80, line 24, as follows: 

VI . 1 . The Lagrangian Relaxed Assignment Problem [.] 
The [three dimensional! three-dimensional assignment 
problem ([5.11 6.1 ) has three sets of constraints and one can 
describe the relaxation by relaxing any of the three sets of 
constraints, the description here is based on relaxing the 
last set of constraints. A (M 3 +l ) -dimensional multiplier 
vector (i.e., u 3 E ^ M 3 +1 ) associated with the 3tth]rd constraint 
set will be denoted by u 3 = [u 0 3 , iz-j 3 , u^ T with Uq = 0 being fixed 
for notational convenience. (The zero multiplier lz 0 3 =0 is used 
for notational convenience.) Now, the three-dimensional 
assignment problem ([5.11 6.1 ) is relaxed to a two-dimensional 
assignment problem by incorporating last set of constraints 
into the objective function via the Lagrangian. Although any 
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constraint set can be relaxed, we choose the last set of 
constraints for convenience. The relaxed problem is 

<D 3 {u 3 ) ^Minimize <p 3 (z 3 ;u 3 ) = $J £ c i i ± z l i i 

i x =0 i 2 = 0 i 3 =0 123 123 

+ix[ £ £ ^-ll 

i 3 =0 3 L ii = 0 i 2 = 0 123 J 

s Minimize £ j£ fcjn + u i 3 ] z/ii u i 

i T =0 i 2 =0 i 3 =0 L 1 2 3 3J 123 i 3 =0 3 

Subject to £ £ =1, i =1,...,M., 

i 2 =0 i 3 =0 123 
i 1 = 0 i 3 = 0 123 

Amend the paragraph beginning at column 80, line 57, as follows: 

One of the major steps in the algorithm is the 
maximization of |"<I^Y 3 Au 3 1 & ? (u 3 ) with respect to the 
multiplier vector u 3 . It turns out that <P 3 is a concave, 
continuous, and piecewise affine function of the multiplier 
vector u 3 , so that the maximization of & 3 is a problem of 
nonsmooth optimization. Since many of these algorithms 
require a function value and a subgradient of [^> 3 Y 3 A] _0 3 _at 
any required multiplier value (u 3 ), we address this problem in 
the next subsection. We note, however, that there are other 
ways to maximize @ 3 and the next subsection addresses but one 
such method. 

Amend the paragraph beginning at column 80, line 65, as follows: 

VI . 2 . Properties Lagrangian Relaxed Assignment 
Problem [ . ] 
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For a function evaluation of [<£> 3 ] we show that an 

optimal (or suboptimal) solution of this relaxed problem 

( [5.21 6.2 ) can be constructed from that of a two-dimensional 
assignment problem. Then, the nonsmooth characteristics of 

[$3] 0 ? are addressed, followed by a method for computing a 
subgradient . 

Amend the paragraph beginning at column 81, line 4, as follows: 

Evaluation of ff,. Define for each an index 

j' 3 = J 3 (i 1 ,i 2 ) and a new cost function c\ ± by: 



Given an index pair (i lf i 2 ) , j 3 need not be unique, resulting 
in the potential generation of several subgradients 
([5.111 6.11 ). (We further discuss this issue at the end of 
the Subsection [5.2.3].) 

Amend the paragraph beginning at column 81, line 18, as follows: 

Now, define 




( [5.3] 6^3) 
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S 3 [u 3 ) ^Minimize <f 3 (z 2 ;u 3 ) = cl L z 2 ii - £ u\ . 

i t =0 i 2 = 0 12 12 i 3 =0 3 

Subject To £ =1, i^l,...,^, (6.4) 

1 2 =0 1 2 

£ zfi =1, i 2 = l, ...,M 2 , 

z z 2 ii2 e{0,l} for all i lt i 2 . 



[(5.4) ] 

As an aside, two observations are in order. The first is 
that the search procedure needed for the computation of the 
relaxed cost coefficients in ( [5.31 6.3 ) is the most 
computationally intensive part of the entire relaxation 
algorithm. The second is that a feasible solution [z 3 ]zf of a 
sparse problem ([5.11 6.1 ) yields a feasible solution z 2 of 
([5.41 6.4 ) via the construction 

2 ll, if z\ ± ± =1 for some (i.,i„,i,), 
10, otherwise. 



Thus the two-dimensional assignment problem ( 15. 41 6. 4 ) has 
feasible solutions other than those with exactly one nonzero 
index if the original problem ([5.11 6.1 ) does. 

Amend the paragraph beginning at column 81, line 47, as follows: 

The following Theorem [5.11 6.1 states that an optimal 
solution of ( [5.21 6.2 ) can be computed from that of 
([5.41 6.4 ) . Furthermore, if the solution of either of these 
two problems is e -optimal, then so is the other. The 
converse is contained in Theorem [5.21 6.2 . 
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Amend the paragraph beginning at column 81, line 51, as follows: 

Theorem [5.1] 6.1 . Let [co 2 ]wi be a feasible solution to the 

[two dimensional] two-dimensional assignment problem 

([5. 4] 6^4) and define w 3 by 

3 2 ([5.5]6 

w i 1 ± 2 i 3 = w ± x i 2 ifi 3 =3 3 and (i x , i 2 ) * (0, 0) , 

w i 3 1 i 2 i 3 = 0 ifi 3 *j 3 and (i lf i 2 ) * (0, 0) , 

w ooi 3 =1 if c 0 3 oi 3 + "i 3 ^ 0 , 

w 0 3 0i3 =0 if Cq^ + u^O. 



Then w 3 is a feasible solution of the Lagrangian relaxed 
problem (6.2) and [<J>y 3 3 A Oy 2 3 A e e 2 ] <p 3 (w 3 ; u 3 ) = <p 3 {w 2 ; u 3 ) . If, 
in addition , w 2 is optimal for the [two dimensional] two- 
dimensional problem, then w 3 is an optimal solution of the 
relaxed problem and <t> 3 (u 3 ) = & 3 (u 3 ) . 

Amend the paragraph beginning at column 81, line 63, as follows: 

With the exception of one equality being converted to an 
inequality, the following theorem is a converse of Theorem 
[5.1] 6^1. 

Amend the paragraph beginning at column 81, line 66, as follows: 

Theorem [5.21 6.2 . Let w 2 be a feasible solution to problem 
([5.2] 6^2) and define w 2 by 
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« ([5.7]6^6) 

W li, = 52 <*W, f ° r ( i l' i 2 > " ( 0 ' 0 > ' 

i 3 =0 

w 0 2 0 = ° if (i lf i 2 ) - (0,0) and c 0 3 0i3 + > 0 for all i 3 , 

w 0 2 0 = l if {i ir i 2 ) = (0,0) and c 0 3 0i3 + u.?<; 0 for some i 3 . 

Then w 2 is a feasible solution of the problem ( [5.41 6.4 ) and 
0 3 {w 3 ; u 3 ) £ <p 3 {w 2 ; u 3 ) . If, in addition, w 3 is optimal for 
([5.2](L_2), then w 2 is an optimal solution of ([5.41 6. 4 ) , 
<p 3 (w 3 ;u 3 ) =<p 3 (w 2 ;u 3 ) and <t> 3 ( u 3 ) = & 3 ( u 3 ) . 

Amend the paragraph beginning at column, 82, line 16, as follows: 

Given [u 3 ]uf the problem of computing [<I> 3 y 3 A] & ? (u 3 ) and a 
subgradient of [<I> 3 y 3 A] ( u 3 ) can be summarized as follows. 

1. Starting with problem ([5.11 6.1 ), form the relaxed 
problem ( T5.21 6.2) . 

2. To solve ( T5.21 6.2 ) optimally, define the [two 
dimensional] two-dimensional assignment problem 
([5.4] JL!) via the transformation ([5.31 6.3 ) . 

3. Solve the two-dimensional problem ([5.41 6.4 ) optimally. 

4. Reconstruct the optimal solution, say [ w] [3] # 3 , of 
( [5.21 6.2 ) via equation ([5.61 6.6 ) as in Theorem 
[5.116.1. 

5. Then 

[ (5.10) ] 



155 



* 3 < u 3 >=*3<* 3 '-« 3 >=£ £ £ c w3<v 3 + 

i^O i 2 = 0 i 3 =0 123 123 

£ u ?l£ £ ^W, 



(6.7) 



A subgradient is given by substituting [ pp 3 ] ft 3 into the 
objective function ([5.21 6.2 ), erasing the minimum sign, 
and taking the partial with respect to u? . The result is 

[ (5.11) ] 



d0 3 (u 3 
8u- 



= 1 , . . . , M . 



(6.8) 



Amend the paragraph beginning at column, 82, line 44, as follows: 

VI . 3 . The Recovery Procedure [ . ] 
The next objective is to explain a recovery procedure, i.e., 
given a feasible (optimal or suboptimal) solution w 2 of 
([5.4] JLJL) (or w 3 of ([5.21 6.2 ) constructed in Theorem 
[5.11 6.1 ) , generate a feasible solution [z 3 ]z^ of equation 
([5.11 6.1 ) which is close to w 2 in a sense to be specified. We 
first assume that no variables in ( T5. 1] 6. 1 ) are preassigned to 
zero; this assumption will be removed shortly. The difficulty 
with the solution w 3 in Theorem [5.11 6.1 is that it need not 
satisfy the third set of constraints in ([5.11 6.1 ) . (Note, 
however, that if w 2 is an optimal solution for ([5.41 6.4 ) and [ 
] w 3 , as constructed in Theorem [5.11 6.1 , satisfies the relaxed 
constraints, then w 3 is optimal for ([5.11 6.1 ).) The recovery 
procedure described here is designed to preserve the 0-1 
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character of the solution w 2 of ( T 5 . 4 1 6.4 ) as far as possible: 
If wl ± =1 and i^O or i 2 *0, the corresponding feasible solution 
z 3 of ( T 5 . 11 6.1 ) is constructed so that z? i i -1 for some 
(i 1 ,i 2 ,i 3 ). By this reasoning, variables of the form z 0 3 0i [,] can 
be assigned a value of one in the recovery problem only if 
w 0 2 0 = l. However, variables z 0 3 0i will be treated differently in 
the recovery procedure in that they can be assigned either_ zero 
or one independent of the value w 0 2 0 . This increases the 
feasible set of the recovery problem, leading to a potentially 
better solution. 

Amend the paragraph beginning at column 82, line 66, as follows: 

Let | ( i. x ( -Z. 2 ) , i 2 ( 2 2 ) }^ 1 _ Q be an enumeration of indices {i 1 ,i 2 } 
of w 2 (or the first 2 indices of w 3 constructed in equation 

r (5) 1 (6.5) such that n^,,^, = 1 for (i 1 (1 2 ) , i 2 (1 2 ) (0, 0) and 
[i 1 (1 2 ) , i 2 (1 2 ) )= (0, 0) for 1 2 =0 regardless of whether Wq 0 = 1 or not. 

(The latter can only improve the quality of the feasible 
solution. ) 

Amend the paragraph beginning at column, 83, line 5, as follows: 

Next to define the two-dimensional assignment problem that 
restores feasibility, let 

[ (5.12) 1 (6.9) 



c V 3 = c iiU2)i2(l2 > i3 for 1 2 = 0, 



Then the two-dimensional assignment problem that restores 
feasibility is 
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L M r (5.14) 1 (6.10) 

Minimize £^ ]T) c\ t z\ ± 

1 2 =0 i 3 =0 23 23 

Subject to 22 z^ i3 = l, 1 2 = 1,...,L 2 , 
z li 3 = 1 ' i 3 = 1 — > M 3> 

2 2 = 0 

z^efo,!} for all l 2 ,i 3 . 



Amend the paragraph beginning at column 83, line 26, as follows: 

The next objective is to remove the assumption that all 
cost coefficients are defined and all zero-one variables are 
free to be assigned. We first note that the above construction 
of a reduced fdimensionl two-dimensional assignment problem 
( f5 . 131 6. 11 ) is valid as long as all cost coefficients c 2 are 
defined and all zero-one variables in z 2 are free to be 
assigned. Modifications are necessary for sparse problems. If 
the cost coefficient c? (I)i (1 }i is well-defined and the zero-one 
variable z 2 ? {i 2 )± 2 {i 2 )± 3 is free to be assigned to zero or one, then 
define cf^ = cl^ (1 ^ ^ as in ( [5. 121 6. 10 ) with zl (1)i(1)i being 
free to be assigned. Otherwise, z\ i is preassigned to zero or 
the corresponding arc is not allowed in the feasible set of 
arcs. To ensure that a feasible solution exists, we now only 
need ensure that the variables z 2 2 0 are free to be assigned for I 2 = 0 , 1 , ... , L 1 
with the corresponding cost coefficients being well-defined. 
[(] Recall that all variables of the form z? 00 ,ZQ i0 and z 0 3 0i are 
free (to be assigned) and all coefficients of the corresponding 
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form c? 00 , c 0 3 i0 and c 0 3 0i need to be defined . Dl This is 
accomplished as follows: [ If] if the cost coefficient c 3 (1 }i (I )0 
is well-defined and z 2 ? (i)0 is free, then define 
c\ o = c 3 (I }i (1 )0 with z_f 0 being free. Otherwise, since all 
variables of the form z 3 0 and z^ ± 0 are free to be assigned with 
the corresponding costs being well-defined, set 
c i 2 o = c i 1 a 2 )oo + c oi 2 (i 2 )o^- where the first term is omitted if i 1 (l 2 )=0 
and the second, if i 2 (I 2 )=0. For i 1 (l 2 )=0 and i 2 (I 2 )=0, define 

2 _ 3 
'-00 ~ ^000 • 

Amend the paragraph beginning at column 83, line 52, as follows: 

VI . 4 . The final recovery problem [.] 
The recovery problem for the case f JJ=31 N = 3 is 

^ ^ ([5.14]6^11) 
Minimize $2 2 c i i z i i 

1 2 = 0 i 3 =0 2 3 2 3 

Subject to 22 z ii =1 r l 2 = l,-,L 2 , 

i 3 =0 2 3 

i; <; 3 =i ' i 3 =i — ^ 

1 2 = 0 

zj^ e {0,1} for all 2 2 ,i 3 . 
Amend the paragraph beginning at column 84, line 1, as follows: 

Let Y be an optimal or feasible solution to this [2- 
dimensional] two-dimensional assignment problem. The recovered 
feasible solution z 3 is defined by 

z 3 if WV'W^) and Y l 2 i 3 = 1 > ([5 - 15] ^^ } 

ili2is \o, otherwise. 
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Said in another way, let {(i 2 (I 3 ) , i 3 (2 3 )}^ 3 =Q be an enumeration of 
indices {l 2 ,i 3 } of Y such that Y 1 {1 } f . {1 ) = 1 for 
(I 2 (J 3 ) ,i 3 (l 3 )l*(0,0) and ( 1 2 ( I 3 ) , i 3 ( I 3 1) = ( 0 , 0 ) for I 3 =0 regardless 
of whether Y 00 =l or not. Then the recovered feasible solution 
can be written as 

( [5.161 6.13 ) 

f ?_ A, if i 1 = i 1 (l 12 ),i 2 = i 2 (l 12 ),i3 = l 3 (2 3 ), 
1 i 2 2 i 3 [o, otherwise. 

The upper bound on the feasible solution is given by 

v 3^ 3 ) =fl £ £ cla Zla ( T5. 171 6. 14 ) 

i 1= 0 i 2 = 0 i 3 =0 123 123 

and the lower by [<t> 3 Y 3 Ay 3 A] 0 , ( u 3 ) for any multiplier value 
(u 3 ) . 

Amend the paragraph beginning at column 84, line 28, as follows: 

In particular, we have 

0 3 {u 3 ) <; 0 3 (u 3 ) <, V 3 (z 3 ) <. V 3 , where u 3 is any multiplier 
value, [Qi> 3 Y 3 Ae z 3 ] (u 3 ) is a maximizer of 0 - ,(\u 3 ]u 3 ), tt3 is an 
optimal solution of the multidimensional assignment problem and 
£ 3 is the recovered feasible solution defined by ([5.161 6.13 ). 

Amend the paragraph beginning at column, 84, line 33, as follows: 

VII. Other Relaxations for the Multidimensional Assignment 
Problem. [ (ABP) ] 

In this section, we briefly describe other possible 
relaxations and their implications. These include linear 
programming relaxations and the corresponding duals. 
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Amend the paragraph beginning at column 84, line 38, as follows: 



Recall from Section II that one starts with the definition 
of the zero-one variable z. . =1 and cost coefficients to form 
the problem [ @ ] 

Minimize c. . z. . 

Subject To E z i l ... i =1 [i 1 = l,~,M 1 ), 

E z i r .i N =1 (i 2 = l,~,M 2 ) , (7.1) 

E * ir ,=i 
i 1 ... Vl i p+1 ...i N i * 

{i p = l,-,M p and p = 2,--,ff-l), 
.E z V i w =1 (i w =l,-,M w ) f 

z. . 6 {0,1} for all i lf -,i N , 



where c 0 ... 0 is arbitrarily defined to be zero. Here, each group 
of sums in the constraints represents the fact that each non- 
dummy report occurs exactly once in a "track of data". One can 
modify this formulation to include multiassignments of one, 
some, or all the actual reports. The assignment problem 
( r 2 . 5 1 3.5 ) is changed accordingly. For example, if is to be 
assigned no more than, exactly, or no less than nf times, then 
the " = 1" in the constraint ( [2.51 3.5 ) is changed to "<.,=,-*. n* 
respectively. Modifications for group tracking and 

multiresolution features of the surveillance region will be 
addressed in future work. In making these changes, one must pay 
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careful attention to the independence assumptions that need not 
be valid in many applications. 

Amend the paragraph beginning at column 84, line 54, as follows: 

Again, the recent work of Poore and Drummond (A.B. Poore 
and O.E. Drummond. Track initiation and maintenance using 
multidimentional assignment problems. In D.W. Hearn, W.W. 
Hager, and P.M. Pardalos, editors. Network Optimization, 
volume 450, pages 407-422, Boston, 1996. Kluwer Academic 
Publishers B. V. ) significantly extends the formulation of the 
track maintenance and initiation to new approaches. The 
discussions of this section apply equally to those formu- 
lations . 

Amend the paragraph beginning at column 84, line 58, as follows: 

VII. 1. The Linear Programming Relaxation [. ] 
In the linear programming relaxation, one replaces the 
zero-one variables constraints 

z. ^. e {0,1} for all i ir ..., i N ( 16.2] 7.2) 

with the constraint 

0'^z ± . <,! for all i lf ...i w . ( [6.217.3) 

Then, the problem ( [6.11 7.1 ) can be formulated as a linear 
programming problem with the constraint ( [ 6 . 21 7 . 2 ) in 
( [6.11 7.1 ) replaced by ( [6.31 7.3 ) with a special block 
structure to which the Dant zing-Wolf e decomposition is 
applicable. Of course, after solving this problem, one must 
now recover the zero-one character of the variables in 
( [6.11 7.1 ) and there are many ways to do this, such as using 
the [two dimensional] two-dimensional assignment problems. 
Commercial software is also available. 
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Amend the paragraph beginning at column 85, line 7, as follows: 



VII . 2 . The Linear Programming Dual and 

Partial Lagrangian Relaxations [. ] 
Given the linear programming relaxation, one can 
formulate the dual problem or the partial Lagrangian 
relaxation duals with respect to any number of constraints. 
In particular, this is precisely what is done in Section 3 on 
the Lagrangian relaxation algorithm presented. The much 
broader class of algorithms provided in the US Patent 5537119 
(Aubrey B. Poore, Jr., Method and System for Tracking 
Multiple Regional Objects by [Multi Dimensional] Multi — 
Dimensional Relaxation, US Patent Number 5537119, filed 14 
March 1995, issue date of 16 July 1996) can be modified to 
remove the zero-one character when one relaxes M sets of 
constraints to an ±N-M[ dimensional 1 ) -dimensional problem and 
recovers with an [N-M-^l dimensional] (N-M +1 ) -dimensional 
problem. This avoids the problems associated with the NP- 
hard ( N-M) - and [N-M+11 (N-M +1) - dimensional problems. 
However, to restore the zero-one character, one can do it 
sequentially with an assignment problem or with one of the 
many zero-one rounding techniques. These formulations are 
easy to work out and thus the details are omitted. 

Delete the paragraphs beginning at column 85, line 31, thru column 85, line 39. 

Amend the paragraph beginning at column 85, line 40, as follows: 

VIII . Hot Starts for Track Maintenance and 

Initiation: Bundle Modifications [ (ABP) 
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Amend the paragraph beginning at column 85, line 43, as follows: 



Thus reuse of multipliers and the first proof that this 
reuse is actually valid was presented in this section. The 
reuse in track maintenance is demonstrated and discussed in 
the work of Poore and Drummond [ fxxl 1 (A.B. Poore and O.E. 
Drummond. Track initiation and maintenance using 
multidimensional assignment problems. In D.W. Hearn, W.W. 
Haqer, and P.M. Pardalos, editors. Network Optimization, 
volume 450, pages 407-422, Boston, 1996. Kluwer Academic 
Publishers B. V. ) . The only item left is the modification of 
the bundle of subgradients for the use with the multiplier 
values as one goes through the recovery problem as in 
[Section 3.6] Section IV. 3. 6 or as one moves the window in 
track maintenance. It is this aspect of the nonsmooth 
optimization that adds an order of magnitude to the speed of 
the algorithms. This work is based on both a mathematical 
proof as in [Section 3.6] Section IV. 3. 6 as well as 
computational experience and heuristics. 

Amend the paragraph beginning at column 85, line 55, as follows: 

IX. [Adaptive Window Size Selection (ABP) . 1 ADAPTIVE AND 
VARIABLE WINDOW SIZE SELECTION 

These data association algorithms , based on the 
multidimensional assignment problem, range from sequential 
processing to many frames of data processed all at once! The 
data association problem for [multisensor multitarget] 
multisensor-multitarget tracking is formulated using a window 
sliding over the frames of data from the sensors. This 
discussion focuses on the work of Poore and Drummond and not on 
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the formulations in [Section 21 Section 2 III . Firm data 
association decisions for existing track are made at, say frame 
k, with the most recent frame being k+M. Decisions after frame 
k are soft decisions. Reports not in the confirmed tracks are 
used to initiate tracks over frames numbered k-I to k+M. 

Amend the paragraph beginning at column 86, line 1, as follows: 

The length of these windows varies from sequential 
processing, which corresponds precisely to [1=01 1=0 and [M=1]M 
= 1 , to user defined large values of I and iVL. [ . (In the case of 
sequential processing, we also have a temporary track file of 
dynamically feasible tracks, but incorrect data association.)] 
There is a marked change in performance over this range. As the 
two windows become exceedingly long, there is little 
statistically significant information gained and indeed 
performance can degenerate slightly. Thus, one must manually 
find the correct window lengths for performance in a given 
scenario and the algorithms do not change for a changing 
environment. Thus we propose an adaptive method for adjusting 
the window lengths. (The method has been highly successful for 
selecting the correct window length for multistep methods in 
ordinary differential equations.) 

1. Compute the solution for different window lengths that 
overlap and differ by one or two frames. 

2. Compare the solution quality, i.e., the value of the 
objective function, for two adjacent window lengths. 

3. If there is a predefined improvement in either direction, 
we then, for stability, repeat the exercise for a shorter 
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or longer on the first try. If there is consistent 
information, we adjust the window size in the indicated 
direction. This can be given a well defined mathematical 
formula in terms of the assignment problems of different 
dimensions . 

[• Algorithm Enhancements due to Data Structures (ABP) . 

• Construction and enumeration of the Best K-Solutions. 

• New Nonsmooth Optimization Techniques. 

• Sensitivity Analysis] 

Amend the paragraph beginning at column 86, line 32, as follows: 

SENSITIVITY ANALYSIS 
For sequential processing in which the [two dimensional] 
two-dimensional assignment algorithm is used, one can use the 
LP sensitivity analysis theory and easily obtain the 
corresponding answers. For the multiframe processing, the 
optimal solution is not available; however, there are still two 
approaches one can use. First, the basic algorithm can perform 
the same sensitivity analysis at each stage (loop) of the 
algorithm as is done in the [two dimensional] two-dimensional 
assignment problem since the evaluation of function ® N _ k+1 is 
equivalent to a [two dimensional] two-dimensional assignment 
problem. Alternately, one could use an LP relaxation of the 
assignment problem and base the sensitivity on the resulting LP 
problem. We currently see this as an important step in finding 
even better solutions to the assignment problem if so desired. 

Amend the paragraph beginning at column 86, line 46, as follows: 

XI. [New Auction Algorithms (ABP & PS)] NEW AUCTION 
ALGORITHMS. 
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In this section we present a new auction algorithm for the 
[two dimensional] two-dimensional assignment problem. 



Amend the paragraph beginning at column 86, line 49, as follows: 

An important step in solving Af-dimensional assignment 
problems for N> 3[,] is finding the optimal solution of the [2- 
dimensionall two-dimensional assignment problem. In particular, 
we wish to solve the r2-dimensional1 two-dimensional problem 
which includes the zero-index. \3 , 1 Typically this problem can 
be thought of as trying to find either a minimum cost or maximum 
utility in assigning person to objects, tenants to apartments, 
or teachers to classrooms. We will follow the work of Bertsekas 
and call the first index set persons and the second index set 
objects. The statement of this problem is given below ( 11. 1) 
when the number of persons is m and the number of objects is n. 

« n [(1)](1U) 

Minimize £ c n x a 

i=0 j=o J J 

Subject to ^2 x i . = l for all i = l,... r m, 

£ x ±j = l for all j = 1, . . . ,n. 



Amend the paragraph beginning at column 87, line 7, as follows: 

There are a couple of assumptions which we will make about 
[(1) 1 (11.1) ■ First of all, we assume that c i0 and c 0j - are well- 
defined and the corresponding variables [x i0 ]x i0 and [x oj ]x Qj are 
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free to be assigned. Second if a cost c ±j happens to be 
undefined, then the corresponding variable [x±j]x±j will be set 
to 0. In effect if c ± j is undefined, we simply remove this cost 
and variable from inclusion in the problem. 

Amend the paragraph beginning at column 87, line 15, as follows: 

Notice that there are no constraints on the number of times 
person 0 and object 0 can be assigned. But notice that the 
first constraint requires that each non-zero person i must be 
assigned exactly once. Similarly, the second constraint forces 
each non-zero object j to be assigned exactly one time. 
Finally, the last constraint gives an integer solution, although 
we will see shortly that this constraint can be relaxed to admit 
any solution \x ± j>0] . One reason for requiring that all of 

the costs of the form [c i0 ]c 10 and [c 0j ]c 0j - be defined is so that 
we are guaranteed a feasible solution exists for the given 
problem. 

Amend the paragraph beginning at column, 87, line 25, as follows: 

XI . 1 . Relaxation of One Constraint [ . ] 

Relaxing the last constraint, we obtain the following 
problem: 



Subject to 



Minimize 




1 



x..e{0,l} . 
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Amend the paragraph beginning at column 87, line 57, as follows: 

XI . 2 . Relaxation of Both Constraints [. ] 

This time we will relax both constraints and Fusinal use 

duality theory to obtain a relationship between the 

multipliers u 1 and u 2 . 

Delete the paragraphs beginning at column 87, line 62, thru column 87, line 65. 

Amend the paragraph beginning at column 88, line 39, as follows: 

In the selection of above, if a tie occurs between 

0 and any non-zero index k, then select j i as k. Otherwise, if 
there is a tie between two or more non-zero indices, the 
choice of j 1 is arbitrary. 

Also if B(j) consists of only one element, then set 

Yj = 00 • 

Delete the paragraph beginning at column 89, line 20, thru column 89, line 22. 

Insert the following heading before the paragraph beginning at column 89, line 23 : 

XII. SOME CONCLUDING COMMENTS 

Amend the paragraph beginning at column 89, line 26, as follows: 

Step 2 is the computational part of the algorithm. 
Evaluating <E> W _*. +1 [XXXl and computing a subgradient use in the 
search procedure requires 99% of the computing time in the 
algorithm. This part uses [two dimensional] two-dimensional 
assignment algorithms, a search over a large number of 
indices, and a nonsmooth optimization algorithm. It is the 
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second part (the search) that consumes 99% of the 
computational time and this is almost entirely 
parallelizable . Indeed, there are [two dimensional] two- 
dimensional assignment solvers that are highly 
parallelizable. Thus, we need but parallelize the nonsmooth 
optimization solver to have a reasonably complete 
parallel izat ion. 
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